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The  relationship  of  a  new  form  of  cloze  test,  multiple 
choice  cloze  (HOC),  to  standard  cloze  and  the  Informal 
Reading  Inventory  (IRI)  was  explored  In  this  study.   The 
Intent  was  to  provide  new  information  that  would  assist  the 
classroom  teacher  in  determining  the  instructional  reading 
level  of  all  students  as  easily  and  accurately  as  possible. 

A  secondary  purpose  of  the  study  involved  a  comparison 
of  MCC  tests.   The  readability  levels  of  the  MCC  passages  were 
determined  by  traditional  methods  and  by  a  new  system  of 
readability  determination,  Rasch  calibration. 


A  third  aspect  of  this  study  focused  on  placement 
decisions  based  on  the  two  types  of  sccrlnf:  criteria  used 
with  the  IHI  to  determine  Instructional  reading  level. 

Second,  fourth,  and  sixth  graders  v;ere  participants  In 
the  study.   Similar  results  at  all  three  grade  levels  sugeest 
generallzablllty  of  results  for  elementary  and  Intermediate 
grade  levels. 

Correlations  between  standard  cloze  and  MCC  were  low 
(ranging  from  r  =  .27  to  .80),  considering  the  same  students 
were  given  the  sa,-ne  stories  in  standard  cloze  and  IKC   forms. 
These  results  raise  some  question  as  to  whether  both  forms 
are  measuring  the  same  type  of  reading  comprehension. 

High  positive  correlations  were  found  between  MCC 
passages  with  readability  levels  determined  by  traditional 
formula  and.  MCC  passages  with  readability  levels  based  on 
Rasch  calibration,  indicating  that  these  two  methods  of 
readability  determination  yield  similar  results. 

A  significant  difference  existed  in  placement  of  stu- 
dents by  the  Powell  and  Betts  IRI  criteria.   These  differences 
in  placement  indicate  that  classroom  teachers  should  carefully 
choose  the  IRI  scoring  criteria  they  will  use  based  on  a 
conviction  of  accuracy  of  placement. 

Three  major  implications  for  future  research  and  practice 
were  derived  from  this  study.   There  Is  some  evidence  that  MCC 
does  not  measure  the  same  type  of  reading  comprehension  as 
measured  by  standard  cloze  or  the  IRI.   The  Information  on 
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this  Issue  Is  Inconclusive  and  further  study  Is  Indicated 
before  more  specific  conclusions  can  be  reached.   The  rela- 
tionship between  standard  cloze  and  the  IRI  also  appears 
tenuous.   The  scoring  criteria  used  for  the  IRI  can  make  very 
significant  differences  In  terms  of  accurate  placement. 
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CHAPTER  I 
INTRODUCTION 

Every  fall,  at  the  start  of  the  school  year,  teachers 
begin  the  process  of  assessing  the  knowledge  and  abilities 
of  their  new  students.   As  part  of  this  process  the  teacher 
seeks  to  determine  the  level  at  which  each  student  can 
successfully  read  and  assimilate  Information. 

It  Is  of  vital  Importance  that  each  student  receive 
reading  Instruction  at  the  proper  level.   That  Is,  the  books 
and  materials  they  use  In  class  should  be  at  a  readability 
level  that  Is  neither  too  easy  nor  too  hard  for  each  Indi- 
vidual student.   This  specific  level,  at  which  materials  are 
challenging  for  the  student  without  being  frustrating  Is 
called  the  Instructional  reading  level.   In  order  for  each 
student  to  make  optimum  developmental  reading  progress,  all 
materials  and  books  should  be  at  his/her  instructional 
reading  level  (Dunkeld,  1970). 

Classroom  teachers  continually  face  the  problen  of 
Identifying  the  instructional  reading  level  for  every  child 
in  the  class.   The  responses  to  this  problem  have  been  varied. 
The  commonly  used  ways  to  determine  instructional  level  are 
teacher  Judgement,  standardized  reading  tests,  Infonnal 
Reading  Inventories  (IRI),  and  cloze  tests  (Oliver,  1970). 
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Teacher  Judgement  Involves  the  placement  of  students  In 
reading  books  based  purely  on  the  teacher's  own  subjectively 
conceived  Ideas.   Teacher  Judgement  has  the  weaknesses  Inherent 
In  any  measurement  based  totally  on  one  person's  opinion.   It 
Is  very  subjective  and  often  Inaccurate.   Research  Indicates 
(Mlllsap,  1962)  that  teachers  are  unaware  of  frustration 
reading  level  among  pupils  In  basal  readers  30  percent  of  the 
time.   Students  are  placed  In  basal  readers  at  their  Instruc- 
tional level  only  70  percent  of  the  time  when  teacher  Judgement 
Is  used.   Although  teacher  Judgement  could  be  Improved  and 
stabilized  with  proper  training  (Mlllsap,  1962),  this  Is  rarely, 
if  ever,  done. 

Standardized  reading  tests  are  group  performance  instru- 
ments.  Patty  (1969)  concluded  that  the  use  of  standardized 
grade  equivalent  scores  is  not  a  valid  basis  for  determining 
Instructional  level.   Standardized  test  norms  appear  to  over- 
estimate pupil  instructional  levels  by  at  least  one  year 
(Klllgallon,  19'i2;   Patty,  1969;  Sipay,  196I;  Williams,  I963). 
Teachers  who  place  students  in  basal  readers  on  the  basis  of 
standardized  test  scores  usually  place  them  at  their  frustration 
reading  level  (Mlllsap,  1962). 

The  IRI  is  considered  to  be  an  accurate  and  often  used 
method  of  determining  instructional  level.   However,  the  IRI 
must  be  individually  administered  and  is,  therefore,  time  con- 
suming for  the  classroom  teacher.   It  takes  approximately  twenty 
minutes  to  properly  administer  an  IRI  to  a  student. 


The  standard  cloze  test  also  provides  an  accurate  measure 
of  Instructional  level.   Cloze  procedure  as  developed  by  Wilson 
Taylor  (1953)  was  designed  as  an  Instrument  for  measuring  the 
effectiveness  of  communication.   Taylor  described  a  functional 
unit  of  cloze  measurement  as  a  successful  attempt  to  reproduce 
accurately  a  deleted  part  of  a  passage.   The  decision  concerning 
the  word  to  be  reproduced  was  made  from  the  remaining  context 
of  the  passage.   In  effect,  the  reader  must  comprehend  well 
enough  to  predict  the  word  that  is  missing.   The  reader  contin- 
uously draws  from  context  clues  to  predict  the  nature  of  the 
language  Immediately  ahead  (Porter,  1976). 

A  cloze  test  is  developed  by  taking  a  passage  of  approx- 
imately 250  words,  leaving  the  first  sentence  intact,  and  then 
deleting  every  nth  word.   It  can  be  administered  to  the  entire 
class  at  one  time  and,  therefore,  is  comparatively  less  time 
consuming  than  the  IRI. 

The  cloze  test,  however,  has  not  gained  wide  acceptance 
by  classroom  teachers.  This  Is  due  to  several  factors.   The 
cloze  test  is  often  very  frustrating  for  the  students.   Also, 
all  the  blank  spaces  in  a  standard  cloze  passage  are  sometimes 
anxiety  provoking.   Students  who  miss  50  percent  of  the  items 
feel  they  have  failed  or  done  poorly.   However,  according  to 
all  existing  cloze  criteria,  50  percent  correct  indicates  the 
passage  Is  at  that  student's  instructional  reading  level 
(Alexander,  I968;  Bormuth,  1967;  Bormuth,  1968;  Rankin  & 
Culhane,  19 69). 


Teachers  also  object  to  standard  cloze  tests  because  of 
the  scoring  procedure.   Only  exact  word  replications  are 
accepted  as  correct.   Synonyms  are  rejected.   Many  teachers 
feel  that  a  synonym  still  Indicates  comprehension  and  should 
be  scored  as  a  correct  answer. 

Standard  cloze  tests  must  also  be  hand  scored  which 
many  teachers  find  cumbersome  and  time  consuming.   Some  criti- 
cism of  the  standard  cloze  procedure  centers  around  the  argu- 
ment that  more  than  comprehension  is  necessary  to  complete  a 
cloze  unit.   Even  though  a  passage  may  be  basically  understood, 
a  student  might  not  be  able  to  actually  produce,  or  write  in, 
the  missing  words.   Especially  in  the  case  of  students  who 
speak  in  a  dialect,  or  for  whom  English  is  a  second  language, 
standard  cloze  test  scores  might  easily  underestimate  their 
true  instructional  level.   It  might  be  hard  for  those  students 
to  make  an  exact  word  replication  even  if  they  fully  comprehend 
the  passage  (Porter,  1976). 

Many  of  the  aforementioned  problems  could  be  eliminated 
by  a  multiple  choice  cloze  (MCC)  test.   Multiple  choice  cloze 
tests  are  based  on  the  principles  of  standard  cloze.   The 
important  difference  between  the  two  forms  is  that  instead  of 
leaving  every  nth  word  blank,  three  to  five  possible  answers 
are  given  for  each  cloze  unit.   The  student's  task  is  to  iden- 
tify the  correct  word,  rather  than  produce  it.   Since  this 
Involves  circling  or  checking  the  correct  word,  rather  than 
producing  the  right  answer,  it  is  much  less  frustrating  to  the 
student.   The  multiple  choice  format  would  also  allow  for  much 


■  simpler  scoring  with  either  machine  scoring  or  the  use  of  an 
overlay. 

It  currently  takes  teachers  approximately  three  weeks 
to  place  students  accurately  in  reading  books.   The  student's 
enthusiasm  for  learning  during  the  first  three  weeks  of  school 
Is  probably  at  its  highest  point.   A  more  efficient  method  of 
determining  instructional  level  would  allow  both  teachers  and 
students  to  capitalize  on  this  eagerness  to  learn.   Using  MCC 
tests  students  could  be  placed  in  reading  groups  by  the  end 
of  the  first  week  of  class,  if  not  sooner. 

Statement  of  the  Problem 

The  primary  purpose  of  this  study  was  to  investigate  the 
relationship  among  standard  cloze,  r4CC,  and  the  IRI.   If  a 
close  relationship  among  all  three  variables  had  existed,  the 
second  intention  was  to  use  standard  cloze  as  a  base  to  set 
up  a  viable  criterion  for  HCC  test  scores  in  regard  to  instruc- 
tional reading  level.   Multiple  choice  cloze  tests  could  then 
be  used  by  classroom  teachers  to  determine  the  instructional 
reading  levels  of  their  students. 

A  third  purpose  was  to  investigate  the  validity  of  KCC 
tests  as  a  measure  of  instructional  reading  level.   The  IRI 
was  used  as  a  base  in  determining  this  aspect  of  the  validity 
of  MCC  tests. 

Another  consideration  was  a  comparison  of  the  IRI 
Instructional  level  scores  as  scored  by  the  Powell  (1969, 
1978)  and  Betts  (1950)  scoring  criteria. 


An  additional  variable  i*as  readability.   Passages  graded 
first  through  seventh  ^a:Je  level  by  traditional  readability 
fonaulas  were  compared  to  a  recent  innovation  In  readability, 
Rasch  calibration.   Two  Tctzls   of  MCC  tests  were  compared;  the 
readability  of  one  set  was  deterr:lned  by  traditional  formulas 
(Dale-Chall,  Karrls-Jacctson,  and  Spache),  and  the  other  set's 
readability  levels  were  P^sch  calibrated. 

Objectives  zr.c.   Pesearch  Questions 

Listed  below  are  the  objectives  of  this  study.   Immedi- 
ately following  each  objective  are  the  specific  questions  that 
will  be  studied. 

The  first  three  questions  are  preliminary  to  the  empir- 
ical validation  of  the  Instrtzaents.   They  offer  empirical 
evidence  of  certain  underlying  assiinptions;  namely,  that  MCC 
tests  are  different  fron  standard  cloze  tests,  that  there  is 
a  difference  in  passage  readability  at  each  level,  and  that 
there  is  an  interaction  between  different  test  forms  and 
different  levels. 
Objective  I 

To  Investigate  the  slriilarity  between  standard  cloze 
jind  MCC  tests  for  the  sarse  passages,  with  the  same  students. 
Question  lA 

Will  there  be  differences  between  the  mean  scores  for 
standard  cloze  and  HCC   passages  for  the  same  group  of  students? 


Question  IB 

Will  there  be  differences  a>-;ong  the  mean  scores  on  the 
three  levels  of  difficulty  (readability  levels)  tested  for 
each  group? 
Question  IC 

Will  there  be  an  Interaction  between  the  forn  used 
(standard  cloze  or  MCC)  and  the  level  of  difficulty  (reada- 
bility level)  of  the  passage? 
Objective  II 

To  examine  the  strength  of  the  relationship  between 
standard  cloze  and  MCC  passages  for  the  purpose  of  determining 
whether  standard  cloze  scores  can  te  used  to  predict  MCC 
scores. 
Question  II 

Will  a  correlation  of  .70  or  more  exist  between  standard 
cloze  and  MCC?  The  minimal  criterion  value  of  .70  was  chosen 
for  practical  significance  because  this  would  indicate  the 
shared  variance  of  the  two  neasores  was  close  to  50  percent. 
Ob.1ectlve  III 

To  Investigate  the  relationship  among  standard  cloze 
scores,  MCC  scores,  and  the  IHI. 
Question  IIIA 

Will  there  be  a  relationship  between  standard  cloze 
scores  and  IRI  scores? 
Question  IIIB 

Will  there  be  a  relationship  between  MCC  scores  and  IRI 

scores? 
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Question  IIIC 

Will  the  correlations  be  greater  between  ::CC  scores  and 
IRI  Instructional  level  scores  or  between  standard  cloze 
scores  and  IRI  instructional  level  scores? 
Ob.lectlve  IV 

To  determine  the  reliabilities  of  the  standard  cloze, 
MCC,  and  Kidder  cloze  passages. 
Question  IV 

Will  multiple  choice  cloze  passage  reliabilities  be 
the  same  as  standard  cloze  passage  reliabilities  at  the  same 
level? 
Ob,1ective  V 

To  study  the  relationship  between  two  foms  of  MCC  tests, 
Homan  MCC  and  Kidder  MCC. 
Question  V 

Will  there  be  a  relationship  between  total  Koman  MCC 
scores  and  total  Kidder  cloze  scores? 
Objective  VI 

To  investigate  the  relationship  between  IP.I's  instruc- 
tional level  scores  as  scored  by  the  Powell  criteria  and  Betts 
criteria. 
Question  VIA 

Will  there  be  a  relationship  between  IRI's  instructional 
level  scores  as  scored  by  the  Powell  and  Betts  criteria? 
Question  VIB 

Will  there  be  a  difference  between  instructional  level 
means  as  scored  by  the  Powell  criteria  and  Betts  criteria? 


Question  VIC 

When  the  Powell  and  Betts  criteria  do  not  place  students 
at  the  same  Instructional  level,  will  a  significantly  greater 
proportion  of  students  be  placed  at  a  higher  Instructional 
reading  level  by  the  Powell  criteria  than  the  Betts  criteria? 

Question  VIP 

Will  students  be  placed  at  the  sar.e  Instructional  level 
by  the  Powell  and  Betts  IRI  criteria  at  least  75  percent  of 
the  time? 

Definition  of  Terns 

Betts  Criteria 

The  Betts  criteria  are  the  traditional  standard  set  up 
by  Bmnett  Betts  (1950)  for  determining  instructional  reading 
level  from  an  IRI.   The  Betts  Instructional  level  criteria  are: 
Book  Level     Word  Pronunciation     Comprehension 
All  95%  to  98?  75%   to  892 

Frustration  Level 

Frustration  level  Is  the  reading  level  at  which  the 
Individual  Is  "thwarted  or  baffled  by  the  language  (I.e., 
vocabulary,  structure,  sentence  length)  of  the  materials" 
(Betts,  1950,  p.  152). 
Independent  Level 

Independent  level  Is  the  highest  reading  level  at  which 
the  individual  can  read  with  full  understanding  and  freedom 
from  mechanical  difficulties  (Betts,  1950). 
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Informal  Reading  Inventory  (IP.I) 

An  IRI  Is  a  series  of  graded  passages  with  conprehenslon 
questions  for  each  passage.   It  Is  used  to  assess  a  student's 
level  of  reading  (instructional,  frustration.  Independent). 
Instructional  Level 

Instructional  level  is  the  highest  reading  level  at 
which  systematic  instruction  can  be  initiated  (Eetts,  1950). 
It  is  the  reading  level  at  which  the  student  is  challenged  by 
the  material  without  being  frustrated. 
Multiple  Choice  Cloze  (MCC) 

Multiple  choice  cloze  tests  are  constructed  as  standard 
cloze  tests  and  based  on  the  sane  underlying  principles. 
Every  nth  word  is  deleted  from  a  passage  of  approximately  250 
words.  Each  blank  space  or  item  contains  the  correct  answer 
plus  two  to  four  distractors. 

Multiple  choice  cloze  can  be  easily  scored  by  machine  or 
by  hand  using  an  overlay.  The  MCC  test  retains  the  best  points 
of  standard  cloze  tests  while  reducing  student  anxiety  and 
enhancing  ease  of  scoring.   Evidence  also  seems  to  indicate  it 
Is  a  nore  valid  measure  of  reading  comprehension  than  standard 
cloze  tests  (O'Reilly  &  Streeter,  1977;  Porter,  1976). 
Powell  Criteria 

The  Powell  criteria  are  the  differentiated  criteria  set 
up  by  William  Powell  (1969,  1978)  for  determining  instruc- 
tional reading  level  from  an  IRI : 
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Book  Lev 

el 

V/ord  Pronunclat 
87?  to  9^^% 

ion 

Conorehenslon 

PP-2 

55?  to  80? 

3-5 

92?  to  96? 

60?  to  85? 

6+ 

9^*?  to  97? 

65?  to  90? 

Senantlcally 

Correct  Word 

A  semantlcally  correct  word  is  similar  in  neaning  to  the 
deleted  word  in  a  functional  cloze  unit.   It  would  .T.ake  sense 
in  context  if  substituted  for  the  deleted  word. 

Example.   The  horse  over  the  tree.   Correct 

answer:   JUMPED;  semantlcally  correct  answer:   FELL. 
Standard  Cloze  Test 

A  cloze  passage  is  any  passage  which  has  every  nth  word 
deleted.   No  deletions  are  made  in  the  first  one  or  two  sen- 
tences to  allow  the  theme  of  the  passage  to  be  established. 
The  reader's  task  is  to  fill  in  the  blanks  with  an  exact  repli- 
cation of  the  missing  word.   Cloze  tests  are  distinguished 
from  completion  tests  by  the  fact  that  cloze  test  deletions 
are  made  using  a  set  of  mechanically  objective  and  prespecifled 
rules,  while  the  deletions  in  completion  tests  nay  be  made 
using  subjective  concepts. 
Syntactically  Correct  V/ord 

A  syntactically  correct  word  is  the  appropriate  part  of 
speech  (noun,  verb,  function,  modifier)  needed  to  complete  a 
functional  cloze  unit.   It  is  the  same  part  of  speech  as  the 
correct  word,  but  does  not  necessarily  make  sense  If  substi- 
tuted for  the  correct  word. 
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Example.   The  Jumped  over  the  tree.   Correct 

answer:   HORSE:  syntactically  correct  answer:   CKAIR. 

Limitations  of  the  Study 

There  are  five  points  to  be  considered  as  possible 
limitations  of  this  study.  The  sample  used  was  not  randomly 
selected  from  the  total  population.   Therefore,  Generalizing 
from  these  results  should  be  done  with  caution. 

The  second  graders  were  tested  In  only  two  sessions. 
Due  to  the  age,  attention  span,  and  slow  rate  of  speed  at 
which  second  graders  work,  many  of  them  tired  and/or  gave  up 
before  they  had  completed  all  the  passages.   It  took  many 
second  graders  an  hour  to  conplete  the  passaces  when  the 
standard  cloze  and  Kidder  cloze  passages  were  administered 
together. 

Three  limitations  involved  the  IRI.   The  comprehension 
questions  for  the  IRI  were  limited  in  number,  only  five  per 
passage.   With  only  five  questions,  a  student  who  missed  one 
question  would  automatically  be  at  instructional  level.   The 
student  might  actually  be  able  to  handle  the  material  independ- 
ently, but  due  to  carelessness,  or  misunderstanding,  one 
question  was  missed.   Five  questions  allow  for  little  differ- 
entiation between  independent,  instructional,  and  frustration 
reading  levels. 

The  students  v;ere  able  to  reread  the  IRI  to  locate 
specific  information.   Several  of  the  comprehension  questions 
directed  the  student  to  "look  In  the  passage  for,"  or  "find" 
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a  specific  word.   This  allowed  for  some  rereading  of  the  pas- 
sage which  might  affect  the  results.   However,  ti.e  rereading 
was  only  to  locate  specific  words  or  information. 

In  addition,  IRI's  were  given  to  only  thirty  to  thirty- 
three  students  at  each  grade  level.   Giving  every  student  an 
IRI  would  have  presented  nore  complete  data  for  analysis. 
However,  due  to  the  tine  involved  in  administering  IRI's  to 
518  students,  it  was  not  feasible  for  this  study. 


CHAPTER  II 
REVIEV;  OP  RELATED  LITERATURE 


History  and  Develornent 


Wilson  Taylor  (1953)  is  credited  with  the  development 
of  cloze  procedure.   Ke  introduced  it  as,  ".  .  .a  new  psycho- 
logical tool  for  measuring  the  effectiveness  of  communication" 
(Taylor,  1953,  P-  123).   He  recognized  and  tested  its  useful- 
ness as  a  new  approach  to  readability.   Cloze  procedure  was 
seen  as   "...  a  method  of  intercepting  a  message  from  a 
•transmitter'  (writer  or  speaker),  mutilating  its  language 
patterns  by  deleting  parts,  and  so  administering  it  to  receivers 
(readers  and  listeners)  that  their  attempts  to  make  the  patterns 
whole  again  potentially  yield  a  considerable  number  of  cloze 
units"  (Taylor,  1953,  p.  126). 

An  actual  cloze  unit  was  considered  any  single  occurrence 
of  a  successful  attempt  to  reproduce  accurately  a  deleted  part 
of  a  passage  or  message.   The  method  used  to  supply  the  missing 
part  was  determined  from  the  remaining  context  (Taylor,  1953). 

The  term  "cloze"  comes  from  the  Gestalt  concept  of 
closure  (Taylor,  1957).   1'his  concept  relates  to  the  tendency 
to  "see"  a  not  quite  complete  circle  as  a  whole  circle  by 
mentally  completing  the  picture.   The  same  concept,  Taylor 
assumed,  held  true  of  people  trying  to  complete  a  mutilated 
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sentence  by  filling  in  the  vrcrds  that  -ade  the  finished  pat- 
tern of  language  symbols  fit  the  apparent  meaning:. 

Ohmacht,  Weaver  and  Kohler  (157C),  in  an  attempt  to 
factor  analyze  cloze  prosedure,  fc-^nd  only  a  moderate  correla- 
tion between  cloze  factors  and  perceptual  cloze  factors.   The 
actual  relationship  betvfeer.  the  Gestalt  concept  of  closure  is 
still  open  to  question. 

Another  aspect  of  cloze  proced-.;re  Investigated  by  Taylor 
(1953)  was  its  use  for  detemlning  readability.   In  a  corre- 
lational study  using  the  Dale-Chall  C^ale  &  Chall,  ig'iS)  and 
Plesch  (Flesch,  19^*8)  readability  fcrrulas,  cloze  procedure 
was  shown  to  be  an  effective  and  reliable  method  of  contrasting 
the  readability  levels  of  various  passages. 

Taylor  (1957)  assur^ed  that  readability  and  comprehensi- 
blllty  were  essentially  synonyr:ous  terr^.   He  saw  the  readabil- 
ity level  as  being  the  sar^  as  the  uKderstandabillty  of  a 
passage.  This  would  seen  to  be  true  If  readability  formulas 
are  accurate.  Generally,  the  lower  the  readability  level  of 
a  passage,  the  easier  It  is  to  understand. 

Taylor  (1953)  specified  that  clcze  procedure  does  not 
deal  directly  with  specific  neanl.ngs  of  words.   The  total  con- 
text and  the  redundancy  of  oar  langTiage  are  actually  involved. 
Cloze  procedure  counts  the  instances  cf  language  usage  corres- 
pondence, and  not  the  neanings  themselves.   This  relates  to  a 
measure  of  the  likeness  between  a  i^iter's  patterns  and  the 
patterns  the  reader  is  anticlpatir^  vhlle  reading.   Agreement 
between  the  writer's  pattexr.s  and  the  reader's  anticipated 
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patterns  create  a  languace  usage  correspondence.   Taylor 
(1953)  credited  ideas  fron  the  total  language  context  concept, 
Osgood's  dispositional  mechanlsr.s,  and  statistical  random 
sampling  as  contributing  to  the  development  of  cloze  procedure. 

In  simplistic  terms,  cloze  procedure  involves  leaving 
every  nth  word  of  a  passage  blank.   The  student  then  fills  in 
those  blanks  using  the  context  to  determine  the  missing  word. 

Cloze  procedure  has  been  and  continues  to  be  studied. 
Taylor  (1953)  saw  its  potential  as  an  approach  to  readability. 
Believing  that  readability  and  comprehensibillty  were  similar. 
If  not  the  same,  his  original  studies  explored  heavily  in 
that  area.   Taylor  developed  the  form  of  standard  cloze  most 
often  used  today. 

Methodological  Considerations 

Any  passage  may  be  used  as  the  basis  for  a  cloze  test. 
In  his  original  study,  Taylor  (1953)  experimented  with  ti:o 
types  of  deletions,  random,  and  every  nth  v/ord.   Random  dele- 
tions were  chosen  by  a  random  number  generator  in  accordance 
with  the  belief  that  if  enough  words  were  struck  out  at  random, 
the  blanks  would  come  to  represent  proportionately  all  kinds 
of  words  to  the  extent  that  they  occur  In  the  passage.   The 
second  and  more  convenient  method  was  every  nth  word  deletions. 

Several  studies  have  supported  the  indication  that  every 
fifth  word  deletion  discriminates  best  in  passages  above  third 
grade  level  (Rankin,  1959;  Rankin,  1965;  Taylor,  1953),  unless 
the  passage  is  extremely  technical  in  which  case  every  tenth 
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word  deletions  are  reconmended  (Cranney,  1963;  Taylor,  1953). 
In  a  separate  study,  MacGlnltle  (I96I)  found  that  additional 
context  beyond  five  words  did  not  help  in  the  restoration  of 
missing  words.   He  also  concluaed  that  onittlng  every  third 
word  made  restoration  difficult. 

Salzinger,  Portnoy  and  Feldr.an  (19^2)  concluded  that 
having  six  words  on  either  side  of  the  cloze  blank  did  not 
produce  more  correct  guesses  than  leaving  four  words  on  either 
side  of  the  cloze  item.  They  felt  students  were  either  unable 
to,  or  simply  did  not,  make  use  of  context  of  more  than  five 
words  on  either  side  of  the  cloze  blank. 

Fillenbaum,  Jones  and  Rappoport  (196'4)  did  a  study  using 
deletions  every  two  words  up  to  deletions  every  six  words. 
They  found  the  greatest  differences  in  performance  between  the 
passages  with  deletions  every  two  words  and  deletions  every 
three  words.   They  pointed  out  that  with  deletions  every  two 
words  the  students  were  sometimes  able  to  guess  form,  but 
rarely  capable  of  replacing  the  words  correctly. 

The  length  of  Taylor's  (1953)  original  passages  was 
approximately  175  words,  allowing  for  thirty-five  deletions. 
Taylor  concluded  that  scores  tended  to  stabilize  after  the 
first  twenty  to  forty  words  of  an  any-word  type  of  deletion 
passage.   In  a  later  study,  Taylor  (1956)  recommended  fifty 
deletions  as  a  suitable  length  for  cloze  tests.   Ho  statistical 
support  was  given  for  the  fifty  deletion  suggestion. 

Rufener  (1972)  used  shorter  passage  lengths  in  deference 
to  the  young  age  of  her  subjects.   The  number  of  deletions 
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ranged  from  eighteen  for  the  second  grade  level  passage  to 
twenty  for  the  sixth  grade  level  passage.   Rufener  used 
cumulative  scores  based  on  percentages  to  ascertain  the  sta- 
bility and  reliability  of  cloze  scores.   She  found  stable 
scores  on  some  passages  within  the  range  of  ten  to  twenty 
deletions,  or  fifty  to  one  hundred  words  In  the  passage.   She 
concluded  that  stability  of  scores  was  more  a  function  of  the 
Individual  cloze  passage  than  the  length  of  the  passage. 

A  final  question  concerning  cloze  test  construction 
Involves  rational  versus  mechanical  deletion  of  words.   Mechan- 
ical, also  called  any  word  deletion,  refers  to  every  nth  word 
deletion  regardless  of  the  grammatical  form  of  the  word. 
Rational  deletion  involves  deleting  only  words  that  have  a 
special  grammatical  function  (Rankin,  1959).   These  words  may 
be  only  nouns,  verbs,  adjectives,  and  adverbs,  as  is  the  case 
for  lexical  cloze.   Lexical  cloze  Involves  the  meaning  of  Indi- 
vidual words.   This  differs  from  what  standard  cloze  Is  assumed 
to  actually  measure,  structural  meaning.  Structural  meaning 
is  signaled  by  a  system  of  morphological  and  syntactical  clues 
apart  from  words  as  vocabulary  units. 

Taylor  (1953)  Indicated  that  If  only  Important  words 
such  as  nouns,  verbs,  adverbs,  and  adjectives  were  deleted  it 
might  not  reflect  the  passage  meaning  accurately.   Two  passages 
of  equal  length  might  contain  a  very  different  number  of 
meaning  conveying  words,  possibly  as  much  as  double  the  amount 
In  the  passage  containing  the  fewest  nouns,  verbs,  adverbs. 
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and  adjectives.   The  effect  of  this  on  the  subjects  should 
be  Included  In  the  results  of  the  cloze  test. 

Rankin  (I965)  discovered  that  nechanlcal  deletion  pro- 
duced a  sizeable  number  of  nondiscriminating  Items  vhlch  mlcht 
lower  the  reliability  of  the  cloze  test.   However,  the  nunber 
of  Items  (deletions)  In  the  passage  could  be  increased, 
thereby  Increasing  the  reliability  of  the  passage.   Pankln 
also  Indicated  that  any  word  deletion  cloze  tests  correlated 
more  highly  with  the  criterion  tests  of  prereading  knowledge, 
recall,  and  aptitude.   Due  to  this  he  considered  mechanical 
deletions  superior. 

Greene  (1965)  compared  mechanical  and  rational  deletions. 
The  rational  deletions  produced  higher  reliabilities  and  item 
discriminations.   However,  Greene  noted  that  the  difference  in 
time  necessary  to  construct  the  rational  cloze  tests  often 
outweighed  the  advantage  of  a  slight  gain  In  reliability, 
especially  since  there  were  no  significant  differences  between 
the  mean  scores  of  the  students. 

Bloomer  (1966)  and  Louthan  (1965)  both  Investigated 
various  forms  of  rational  deletions.   Bloomer  (1966)  concluded 
that  marked  comprehension  losses  occur  "where  the  structure  of 
the  prose  and  its  meaning  are  broken  by  deletions  of  the  basic 
meaning  carriers  of  the  language,  i.e.,  nouns,  verbs,  and 
modifiers"  (p.  66).   His  results  suggest  that  the  part  of 
speech  deleted  does  have  an  effect  on  the  ability  of  the 
individual  to  complete  cloze  procedure  tests. 
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Louthan  (1965)  indicated  that  systematic  deletions  of 
structural  function  words  (nouns,  verbs,  adjectives)  would 
produce  a  loss  in  reading  conprehension,  regardless  of  the 
number  of  deletions.   In  a  similar  study,  Rankin  (1959) 
reported  that  mechanical  deletions  correlated  significantly 
higher  with  reading  comprehension  sections  of  the  Diagnostic 
Reading  Test  than  rational  deletions. 

In  scoring  cloze  tests,  points  may  be  awarded  for  exact 
word  only  or  synonyms  accepted.   Taylor  (1953,  1956)  recom- 
mended giving  credit  for  exact  word  answers  only  since  this 
retains  the  objectivity  of  cloze  procedure.   Accepting  synonyms 
has  been  suggested  as  beneficial  when  using  cloze  procedure  as 
a  teaching  technique  (Jongsna,  1971).   However,  if  synonyms 
are  counted  as  correct,  the  subjectivity  of  the  scorer  becomes 
an  issue.   Also,  Cronbach,  as  paraphrased  by  Taylor  (1953) 
states  that  cloze  tests  scored  objectively  satisfy  the  assump- 
tions for  true  scores  and  can  be  considered  as  such. 

The  areas  covered  by  methodological  considerations  all 
Involve  deletions.  The  literature  reviewed  indicates  a  strong 
preference  for  using  every  fifth  word  deletion.   The  number  of 
deletions  has  been  known  to  range  from  eighteen  to  over  fifty 
and  still  maintain  relatively  high  and  stable  reliabilities. 

The  issue  of  mechanical  versus  rational  deletion  has 
proponents  on  both  sides.   Most  of  the  researchers  favor 
mechanical  deletion  even  though  that  method  often  lowers 
passage  reliabilities.   There  is  almost  total  agreement  on 
scoring  by  exact  answer  only.   Once  the  subjectivity  of  the 
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scorer  becomes  a  factor,  the  cloze  scores  could  no  longer  be 
considered  true  scores.  Many  of  these  Issues  are  still  under 
Investigation  (O'Hellly  &  Streeter,  1977). 

Reliability, 

Taylor's  (1953)  original  study  produced  a  cloze  test 
Internal  consistency  measure  of  .56  using  Kendall's  W.   Rankin 
(1965)  pointed  out  that  mechanical  selection  of  words  might 
produce  a  sizeable  n-aiuber  of  nondiscriminating  items  which 
lower  reliability.   However,  other  studies  of  cloze  procedure 
have  yielded  very  high  reliabilities.   In  a  validity  study 
involving  cloze  procedure,  Bormuth  (1969)  used  split-half 
reliabilities  and  produced  highly  satisfactory  reliability 
coefficients  ranging  from  .92  to  .giJ.   In  a  study  Involving 
mechanical  and  rational  deletion  of  cloze  procedure,  Greene 
(1965)  found  K-P.  #21  reliabilities  of  .76  and  .90.   Cranney 
(1973),  m  a  study  using  cloze  in  both  standard  and  MCC  tests, 
found  reliabilities  using  the  K-R  #20  formula  which  ranged 

from  .83  to  .93. 

Using  MCC  cloze  tests,  O'Reilly  and  Streeter  (1977) 
found  very  high  estimates  of  internal  consistency.   The  K-R  #20 
reliabilities  ranged  from  .9^^   to  .97  with  a  median  reliability 

of  .96. 

The  cloze  reliability  data  available  strongly  indicated 
that  standard  cloze  and  MCC  tests  were  reliable  Instruments. 
However,  no  overt  comparisons  were  made  between  standard  and 
HOC  reliabilities. 


22 


Criteria 

Bormuth  (196? )  recognized  that  a  frame  of  reference  by 
which  to  Interpret  cloze  scores  was  lacking.   In  a  landmark 
study,  Borir.uth  correlated  cloze  test  scores  with  multiple 
choice  scores  to  produce  workable  criteria.   In  this  study 
Bormuth  used  one  hundred  fourth  and  fifth  graders.   The  stand- 
ard cloze  test  had  every  fifth  word  deleted  and  had  fifty 
Items.   By  regressing  cloze  scores  on  multiple  choice  scores, 
a  38  percent  correct  standard  cloze  score  was  equated  with  a 
75  percent  correct  multiple  choice  score.   The  38  percent  was 
the  lower  limit  for  Instructional  reading  level.   A  standard 
cloze  score  of  50  percent  was  comparable  to  90  percent  correct 
on  the  multiple  choice  test.   The  standard  error  of  the 
estimate,  however,  was  six  percentage  points. 

In  a  later  study,  Bormuth  (1968)  correlated  cloze  scores 
with  word  recognition  and  comprehension.   The  Gray  Oral  Reading 
Test  was  used.   The  cloze  tests  contained  fifty  Items  per  test 
and  had  every  fifth  word  deleted.   A  total  of  120  fourth,  fifth, 
and  sixth  graders  comprised  the  sample,  forty  at  each  grade 
level.   A  matching  procedure  was  used  to  determine  comparable 
standard  cloze  and  comprehension  scores.   The  results  Indicated 
cloze  scores  of  414  percent  were  comparable  to  comprehension 
scores  of  75  percent.   The  upper  range  equated  cloze  scores 
of  57  percent  to  comprehension  scores  of  95  percent.   The 
cloze  scores  comparable  to  word  recognition  scores  of  95 
percent  and  98  percent  were  33  percent  and  5'^    percent. 
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respectively.   It  should  be  noted  that  both  of  these  studies 
are  based  on  relatively  small  samples,  especially  considering 
the  generalizablllty  of  these  scoring  criteria. 

Using  a  sample  of  105  fifth  graders,  Rankin  and  Culhane 
(1969)  replicated  Bornuth's  study  and  obtained  similar  results. 
Fifty  item  cloze  tests  with  every  fifth  word  deleted  were 
administered  to  the  students  along  with  multiple  choice  tests 
from  the  same  articles.   Regression  equations  were  set  up  to 
predict  multiple  choice  percentage  scores.   The  criteria  that 
evolved  equated  41  percent  correct  on  a  cloze  test  to  75  per- 
cent correct  on  the  multiple  choice  test.   Also,  61  percent 
correct  on  cloze  tests  was  comparable  to  90  percent  on  the 
multiple  choice  tests.   While  Rankin  and  Culhane  recommend 
that  teachers  interpret  cloze  scores  by  the  criteria  from  this 
study  "with  some  degree  of  confidence"  (Rankin  &  Culhane,  I969, 
p.  197),  it  should  be  noted  that  this  study  involved  only  one 
grade  level. 

In  a  separate  study,  Alexander  (1968)  set  up  criteria 
for  cloze  scores  based  on  instructional  level  IRI  scores. 
Alexander  used  data  from  365  students  in  his  sample  from 
grades  four,  five,  and  six.   The  number  of  cloze  items  ranged 
from  forty-five  to  ninety-two.   Every  fifth  word  was  deleted. 
Alexander's  criteria  had  an  Instructional  level  range  of  47 
percent  to  60  percent  based  on  the  IRI's  Instructional  level 
scores.   The  IRI  instructional  level  scores  were  determined 
using  the  Powell  criteria  (Powell,  1969). 
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All  four  of  these  studies  are  based  on  fourth  only, 
fifth  only,  or  fourth,  fifth  and  sixth  grade  students.   There 
are  possible  differences  ar.cng  these  grade  levels  that  dis- 
courage direct  cocparlson  of  these  cloze  criteria. 

These  standards  for  detemlnlng  cloze  Instructional  level 
are  all  based  on  varying  base  criteria.   However,  the  75  per- 
cent to  90  percent  correct  seens  constant,  even  though  what 
the  75  percent  to  90  percent  neasure  changes  with  each  study, 
covering  the  range  of  multiple  choice  tests,  oral  reading 
tests,  comprehension  questioning  and  the  IRI. 

Measurement  of  Peadlnr  Comcrehenslon 

Conflicting  evidence  exists  in  the  literature  concerning 
the  validity  of  standard  cloze  tests  as  a  measure  of  compre- 
hension.  Borriuth  (1969)  in  a  factor  analytic  study  of  cloze 
tests  found  that  one  factor  accounted  for  77  percent  of  the 
variation  in  the  correlation  riatrix.   Using  a  principal  com- 
ponents analysis,  Bornuth  analyzed  correlations  among  nine 
cloze  tests  and  seven  multiple  choice  comprehension  tests. 
He  concluded  "...  cloze  nade  by  deleting  every  fifth  word 
measure  skills  closely  related  or  identical  to  those  measured 
by  conventional  multiple  choice  reading  comprehension  tests" 
(Bormuth,  1969,  p.  365)- 

Porter  (1976)  stated  tl-at  "the  fact  that  the  ability 
to  predict  what  lies  ahead  depends  on  the  ability  fully  to 
comprehend  the  language  being  processed  at  any  given  moment 
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provides  the  Justification  for  cloze  procedure  as  a  test  of 
comprehension"  (p.  152). 

In  another  factor  analytic  study,  Korton  il9T*-75)   used 
cloze  tests  from  science  and  social  studies,  paragraph  reading 
tests,  and  twelve  tests  designed  to  measure  structure  of  intel- 
lect.  He  performed  several  analyses  and  concluded  that  the 
factors  appeared  to  be  invariant  from  one  analysis  to  the 
others.   The  study  attempted  to  establish  both  construct  and 
concurrent  validity  for  cloze  tests.   The  construct  was 
defined  as  the  ability  to  deal  with  the  linguistic  structure 
of  the  language  as  related  to  the  ability  to  deal  with  rela- 
tionships among  words  and  ideas.   Horton  suggested  the  vari- 
ance shared  among  cloze  tests  and  reading  comprehension  tests, 
reading  gain  tests,  and  verbal  intelligence  tests  are  probably 
a  measure  of  the  student's  ability  to  deal  with  relationships 
among  words  and  ideas.   The  correlations  established  concur- 
rent validity. 

Weaver  and  Kingston  (1963)  also  factor  analyzed  cloze 
tests.   College  level  students  participated  in  the  study.   The 
tests  used  were  the  Davis  Reading  Test,  several  subtests  of 
the  Modern  Language  Aptitude  Test,  the  STEP  Listening  Test, 
the  Ohio  State  Psychological  Examination,  and  eight  cloze 
tests.   Weaver  and  Kingston  concluded  that  cloze  procedure  was 
only  moderately  related  to  verbal  comprehension.   Much 
specific  variance  was  unexplained  by  any  of  the  factors. 
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Bormuth  (1969)  questioned  the  Interpretation  of  Weaver 
and  Kingston's  (1963)  data  for  four  different  reasons.  The 
subjects  were  college  students  which  produced  a  less  varied 
ability  distribution  than  nost  elementary  school  level  studies. 
The  correlations  on  which  they  based  their  calculations  were 
different  from  those  obtained  frorc  other  investigators.   The 
standardized  tests  used  had  unusual  factor  loadings,  and  the 
cloze  tests  had  inconsistencies  in  loading  patterns  anong 
themselves. 

Carroll  (1972)  in  a  discussion  of  comprehension  and 
various  tests  of  comprehension  stated,  "Cloze  technique  in 
Its  usual  form  is  too  crude  to  permit  measuring  the  degree  to 
which  the  individual  cor.prehends  particular  lexical  or  gram- 
matical cues,  or  possesses  a  knowledge  of  specified  linguistic 
rules"  (p.  19).   He  suggests  there  is  no  clear  evidence  that 
cloze  scores  measure  the  ability  to  comprehend  major  ideas  or 
concepts  that  run  through  a  discourse. 

The  evidence  cited  by  Carroll  as  leading  to  this  conclu- 
sion is  the  Weaver  and  Kingston  factorial  study  (1963)  pre- 
viously discussed,  a  study  by  Colem.an  and  Miller  (1968),  and 
Rankin's  (1958)  study.   The  Coleman  and  Miller  (1968)  study, 
as  depicted  by  Carroll  (1972),  attempted  to  measure  knowledge 
gain  from  a  cloze  passage.   A  distinction  between  knowledge 
gain  and  comprehension  or  understanding  is  arguable.   Rankin 
(1959)  concluded  scores  based  on  the  deletions  of  nouns  and 
verbs  seem  to  measure  something  different  than  cloze  scores 
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based  on  deletion  of  function  words.  This  conclusion  has  no 
direct  Implication  In  terms  of  the  ability  of  a  r.ecr-anlcally 
deleted  cloze  passage  to  measure  reading  co.-nprehenslon- 
Therefore,  Carroll  (1972)  does  not  seem  to  have  strcr.?:  ox- 
clear   supportive  evidence  for  his  statements. 

In  another  study  using  college  students  (Anderson,  197^) 
different  conclusions  were  reached.   Anderson  found  clcze 
tests  were  valid  measures  of  comprehension.   Anderssn  also 
noted  that  there  were  more  correct  responses  on  the  cloze 
tests  when  a  MCC  format  was  utilized. 

Porter  (1976)  expressed  his  view  that  standard  cloze 
tests  do  not  measure  what  they  claim  to  measure.   Although 
comprehension  of  the  passage  is  necessary  to  the  successful 
completion  of  a  standard  cloze  passage,  that  alone  Is  not 
enough.   A  student  being  administered  a  standard  cloze  test 
must  produce  language  to  fill  in  each  cloze  space,   Pcrter 
stated  "to  be  valid,  a  test  should  measure  what  It  Is  intended 
to  measure,  and  language  production  is  not  comprehe.ision, 
neither  are  the  two  necessarily  concomitant"  (p.  152)-  A 
student  may  understand  or  comprehend  a  cloze  passage  and  still 
be  unable  to  predict  the  correct  word  for  a  cloze  ite=-   This 
Is  especially  relevant  for  students  who  speak  In  a  dialect, 
or  for  whom  English  is  a  second  language. 

Porter  (1976)  proposed  devising  a  method  of  testing 
comprehension  with  the  advantages  of  standard  cloze  procedure, 
but  without  necessitating  language  production.   The  solution 
he  suggested  was  a  KCC  test.   Although  MCC  would  take  a  little 
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longer  to  construct  due  to  the  added  distractors,  the  added 
test  validity  would  be  worth  the  additional  tine  and  effort. 
Also,  the  process  of  selecting  alternatives  offers  the  possi- 
bility of  nore  control  and  flexibility  than  standard  cloze 
procedure  possessed.   This  control  Is  exer.pllfied  by  being 
able  to  chose  distractors  which  vary  according  to  the  "depth 
of  linguistic  attainment  and  fineness  of  stylistic  discrimi- 
nation of  the  student"  (Porter,  1976,  p.  IS'^). 

An  additional  virtue  of  MCC  is  that  it  can  be  constructed 
so  that  an  overlay  can  be  easily  used  for  scoring,  or  it  can 
be  used  with  answer  sheets  and  machine  scored.   O'Reilly  and 
Streeter  (1977)  also  point  out  that  a  MCC  test  has  greater 
face  validity  as  a  measure  of  comprehension. 

Guthrie  (1973)  correlated  MCC  tests  with  the  Gates 
KacGlnltle  comprehension  and  vocabulary  test  to  measure  the 
validity  of  i"CC  as  a  test  of  reading  comprehension.   The  MCC 
test  correlated  .85  with  the  vocabulary  section  of  the  Gates 
MacGlnltle  and  .82  with  the  comprehension  section.   The 
subjects  In  this  study  were  thirty-six  elementary  aged  normal 
and  disabled  readers. 

Cranney  (1973)  demonstrated  that  a  MCC  test  when  corre- 
lated with  the  Cooperative  Reading  Test  had  a  validity 
coefficient  that  showed  25  percent  shared  variance  with  the 
comprehension  sections  of  the  Cooperative  Reading  Test. 

A  recent  study  of  O'Reilly  and  Streeter  (1977)  stated 
the  belief  that  multiple  choice  technique  would  retain  many 
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of  the  good  points  of  standard  cloze  procedure,  such  as 
absence  of  questions,  and  objective  Iten  construction,  while 
Improving  Its  applicability  as  a  measure  of  reading  compre- 
hension.  Also,  due  to  the  format  of  MCC,  students  would 
suffer  less  from  test  anxiety  which  should  Increase  the 
reliability  of  the  tests.   The  excessive  difficulty  and 
ambiguity  of  the  standard  cloze  test  would  be  greatly  reduced. 

O'Reilly  and  Streeter  (1977)  conducted  a  factor  analytic 
study  of  MCC  tests  using  tests  based  on  Bormuth's  Wi-Items 
format,  the  California  Achievement  Test,  a  Test-Wiseness  Test, 
and  the  Short  Form  Test  of  Academic  Aptitude.   They  concluded 
that  MCC  tests  were  a  measure  of  readinf  comprehension  that 
was  essentially  Independent  of  IQ. 

The  main  factor  of  the  MCC  tests  appeared  to  be  one  of 
literal  comprehension.   However,  there  was  evidence  of  two 
other  factors  possibly  representing  other  forms  of 
comprehension. 

Summary  of  Research 

Cloze  procedure  is  backed  by  a  proliferation  of  research 
as  a  tool  for  measuring  some  sort  of  reading  comprehension. 
A  dialogue  continues  concerning  the  actual  type  and  amount  of 
comprehension  it  measures. 

Many  researchers  have  attempted  to  establish  criteria 
by  which  to  determine  instructional  reading  level  from  cloze 
tests.   All  of  the  research  In  that  area  and  in  most  other 
areas  of  cloze  research  has  been  limited  to  fourth  grade 
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students  and  above.   The  field  Is  open  for  investigating 
primary  and  Intermediate  grade  children  to  see  if  results 
are  generalizable  across  grade  levels. 

The  newest  area  of  research  in  cloze  procedure  appears 
to  be  in  the  area  of  ."CC.  The  relationship  between  this  new 
forra  of  cloze  and  standard  cloze  is  yet  to  be  studied. 

Information  on  the  relationship  of  standard  cloze  scores 
and  the  IRI  is  also  very  limited.   Exploration  of  the  rela- 
tionships and  interrelationships  in  the  aforementioned  areas 
of  MCC,  standard  cloze,  and  the  IRI  night  well  be  of  great 
potential  value  to  the  classroom  teacher.  Through  research 
In  these  areas,  a  way  to  determine  instructional  reading 
level  with  ease,  accuracy,  and  reliability  might  yet  be 
forthcoming. 


CHAPTER  III 
PROCEDURES  AND  METHODOLOGY 


Sample 


The  subjects  were  557  students  selected  from  a  larger 
school  population  of  second,  fourth,  and  sixth  grade  pupils. 
Three  schools  from  the  Pinellas  County  School  System  partici- 
pated in  the  study:   Dunedin  Elementary  School,  Lealman  Ele- 
mentary School,  and  Mt.  Vernon  Elementary  School.   The  total 
second,  fourth,  and  sixth  grade  population  of  Pinellas  County 

Is  18,729. 

These  three  schools  were  selected  because  they  housed 
first  through  sixth  grades  and  the  principals  and  faculties 
were  willing  to  help  with  the  study.   The  schools  were  repre- 
sentative of  three  different  socioeconomic  levels.   This 
determination  was  made  according  to  data  on  free  and  reduced 
lunches.   The  students  who  receive  free  and  reduced  lunches 
are  determined  by  amount  of  family  income.   Therefore, 
classification  on  this  basis  is  Justified. 

Lealman  Elementary  School  had  78  percent  of  its  students 
on  the  free  or  reduced  school  lunch  program.   This  was  con- 
sidered the  low  socioeconomic  school.   Mt .  Vernon  Elementary 
School  had  47  percent  of  its  students  on  the  free  or  reduced 
school  lunch  program.   Mt.  Vernon  was  considered  the  middle 
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socloecononlc  school.   Eunedln  Eler.entary  School  had  19  per- 
cent of  Its  students  participating;  in  the  free  or  reduced  lunch 
program,  and  was  considered  the  high  socioeconomic  school. 

The  students  were  not  assigned  to  classes  on  the  basis 
of  reading  ability.   All  students  in  the  class  were  tested. 
Including  those  Involved  in  special  programs  such  as  Special 
Learning  Disabilities  and  Emotionally  Handicapped.   Absentees 
were  not  given  makeup  tests.   Students  with  incomplete  test 
data  were  eliminated  from  the  study. 

Instrucents  Used 

Each  student  was  tested  on  nine  passages.   The  investi- 
gator wrote  original  passages  ranging  in  readability  levels 
from  1.5  to  approximately  7-5-   Three  of  these  passages  were 
presented  to  the  student  as  standard  cloze  passages.   The 
second  grade  students  received  first,  second,  and  third  grade 
level  passages.   Fourth  grade  students  were  required  to  com- 
plete passages  for  grade  levels  three,  four,  and  five.   Sixth 
grade  students  were  tested  with  fifth,  sixth,  and  seventh 
grade  level  passages. 

The  students  were  also  tested  with  the  same  three  pas- 
sages or  stories  in  an  KCC  fonnat  (Homan  Cloze). 

Additional  MCC  passages  (Kidder  Cloze)  written  for  the 
New  York  School  System  and  Rasch  calibrated  for  readability 
were  also  given  to  each  student.   Three  of  these  passages 
(also  covering  three  grade  levels)  were  completed  by  each 
student.   This  was  done  for  two  purposes:   it  served  as  a 
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check  on  the  readability  level  of  the  original  passages;  and 
It  checked  on  the  posslbllty  of  an  effect  on  the  Hor.an  Cloze 
tests  caused  by  the  student's  previously  taking  a  standard 
cloze  test  on  the  same  story. 

Thlrty-slx  students  were  randomly  selected  at  the  second 
grade  level,  thirty-four  at  the  fourth  grade  level,  and  thlrty- 
slx  at  the  sixth  grade  level,  to  te  adinlnistered  IRI's.   This 
served  as  a  base  measure  of  instructional  reading  level.   It 
was  used  to  establish  the  validity  of  the  Honan  Cloze  and  to 
revalidate  standard  cloze  as  a  measure  of  Instructional 
reading  level. 

Instrument  Developr.ent  -  Original  Passage 

Purpose  of  Instrument 

Stories  of  approximately  135  words  were  written  at  first 
through  seventh  grade  reading  levels.   These  passages  were 
made  into  standard  cloze  and  MCC  tests  to  be  used  to  determine 
the  Instructional  reading  levels  of  second,  fourth,  and  sixth 
graders.   Both  standard  cloze  and  "CC  are  considered  measures 
of  reading  comprehension  which  is  a  direct  reflection  of 
reading  level.   If  a  student  cannot  comprehend  material  suf- 
ficiently at  a  certain  level,  he/she  cannot  effectively  work 
and  learn  at  that  level  of  instruction.   The  original  cloze 
passages,  both  standard  and  nultlple  choice  (Homan  Cloze) 
were  intended  to  provide  a  measure  of  reading  comprehension 
that  could  be  used  to  determine  instructional  reading  level. 
These  passages  are  Included  in  Appendices  B  and  C. 
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Source  of  Items 

Every  fifth  word  was  deleted  from  the  cloze  passages. 
Taylor  (1953,  1956)  and  Rankin  (1965)  both  have  supported  fifth 
word  deletion.   MacGlnltle  (1961)  found  that  additional  context 
beyond  five  words  did  not  help  in  restoration.   In  a  later 
study,  Salzinger,  Portnoy  and  Feldnan  (1962)  also  determined 
that  having  six  words  on  either  side  of  the  cloze  blank  did  not 
produce  more  correct  guesses  than  having  four  words  on  either 
side  of  the  blank.   They  concluded  that  subjects  either  cannot 
or  do  not  utilize  context  of  more  than  five  words  on  either 
side  of  a  blank.   An  additional  conclusion  was  that  words  pre- 
dicted for  every  fifth  blank  are  Independent  of  each  other. 

The  following  list  contains  the  nunber  of  v/ords,  number 
of  deletions,  and  readability  levels  of  the  original  standard 
cloze  passages.   The  Dale-Chall  readabilities  are  approximate 
grade  levels  derived  from  Dale-Chall  Formula  scores  (Dale  & 
Chall,  19t8). 

Words  Deletions  Readability     Source 
1st  grade   100      18         1.5      Spache,  1977 
2nd  grade   138      23         2.5      Spache,  1977 
3rd  grade   126      23         3.5      Spache,  1977 
l(th  grade   lt7      23         '»-8      Harrls-Jacobson 

5th  grade   126      23         5-5      Dale-Chall  (converted 
■^       ^  from  Formula  Score) 

6th  grade   133      23         6.5      Dale-Chall  (converted 

fron  Formula  Score) 

7th  Grade  \2^  21         7-5      Dale-Chall  (converted 

"^  fron  Formula  Score 
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The  following  Is  a  list  of  the  nur.ber  of  words,  deletions, 
and  readability  levels  of  the  Kidder  Cloze  passages: 

Words  Deletions  Readability        Source 

1st  grade   113      18       l-"*  to  1.7  Rasch  calibrated  and 

Spache  Forr.ula  for 

2nd  grade    88      13         2.5      first,  second,  and 

third 

3rd  grade    66 

l(th  trade    65      10         4.66     Rasch  calibrated  and 

Dale-Chall  Formula 


13 

2.5 

10 

3.5 

10 

4.66 

10 

5.42 

11 

5.84 

12 

6.38 

5th  grade    61      10  5.42     Score  for  fourth, 

fifth,  sixth,  and 
6th  grade    74      11         5.84     seventh 

7th  grade    70 

The  MCC  tests  at  all  levels  had  three  selections  for  each 
deleted  word.   One  choice  was  the  correct  answer.   One  of  the 
selections  was  syntactically  correct  but  senantlcally  Incorrect. 
The  third  choice  was  neither  senantically  nor  syntactically 
correct. 

Four  parts  of  speech  were  Identified  for  syntactic  agree- 
ment or  nonagreement  (Guthrie,  1973).   These  categories  were 
noun,  verb,  modifier,  and  function.   The  noun  group  Included 
nouns  and  pronouns.   The  verb  group  Included  verbs  and  auxil- 
iary verbs.   The  modifier  group  Included  adjectives  and  adverbs, 
and  the  function  group  Included  prepositions,  articles,  and 
conjunctions . 

The  syntactically  correct  dlstractors  for  the  first, 
second,  and  third  grade  passages  were  selected  using  systematic 
sampling  from  the  Dale-Chall  List  of  769  words,  and  from  the 
Dale-Chall  List  of  3000  words  for  the  fourth,  fifth,  sixth. 
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and  seventh  grade  passages  (Dale  &  Chall,  igi^S).   In  each  case 
the  nunber  of  items  In  the  cloze  test  was  divided  into  the 
nunber  of  words  on  the  list.   The  word  list  was  then  divided 
Into  equal  groups  using  the  derived  quotient.   If  the  first 
word  of  the  group  was  not  the  needed  part  of  speech,  the  next 
word  on  the  list  that  was  the  correct  part  of  speech  was  used. 
By  using  the  words  on  the  Dale-Chall  lists  the  readability 
level  of  the  distractors  was  controlled. 

The  choice  that  was  neither  syntactically  nor  senanti- 
cally  correct  was  selected  from  the  passage  using  a  random 
number  table.   The  position  of  the  correct  answer  was  randomly 
assigned. 
Scoring 

In  the  standard  cloze  passages  only  the  exact  v;ord  was 
scored  as  correct.   Synonyms  were  not  allowed.   Spelling 
mistakes  were  permitted  as  long  as  the  word  was  still  recog- 
nizable. By  scoring  only  the  exact  word  as  correct,  the 
objectivity  of  the  scoring  procedure  was  greatly  enhanced. 

The  MCC  test  items  were  scored  as  right  if  the  correct 
word  was  circled.   If  the  correct  answer  and  an  incorrect 
answer  were  circled  on  the  same  item,  it  was  considered  a 
wrong  answer. 
Item  Analysis 

An  Item  analysis  was  performed  using  biserial  correlations 
between  individual  item  scores  and  total  scores  for  the  passage. 
A  biserial  correlation  is  used  for  computing  the  correlation 
between  one  continous  variable  and  one  artifically  dichotomized 
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variable.  The  Item  scores  were  considered  an  artificial 
dichotomy  since  other  words,  or  answers,  could  be  inserted 
to  make  sense  In  the  passage  and  so  are  "correct"  in  some 
sense. 

No  Items  were  deleted  based  on  this  item  analysis. 
However,  this  information  may  be  of  value  for  future  research. 
Reliability 

Internal  consistency  estimates  were  computed  as  meas- 
ures of  reliability  on  all  passages,  standard  and  MCC. 
Validity 

Standard  cloze  has  been  shown  to  be  a  valid  measure  of 
reading  comprehension  (Bormuth,  1969;  Rankin,  1959).  Criter- 
ion data  were  collected  by  administering  Information  Reading 
Inventories  to  107  randomly  selected  students.   Multiple 
choice  cloze  and  standard  cloze  scores  were  correlated  with 
IRI  Instructional  levels  to  determine  their  validities. 

Other  InstruKients 

Some  HCC  passages  (Kidder  Cloze)  taken  from  the  Test 
Development  Notebook  developed  by  the  Bureau  of  School  and 
Cultural  Research,  Division  of  Research,  New  York  State  Edu- 
cation Department  were  also  administered  to  each  student. 
The  readability  level  of  these  passages  had  been  determined 
In  two  ways.   A  conventional  method,  the  Spache  Readability 
Pornula  (Spache,  1953)  was  used  for  the  first,  second,  and 
third  grade  passages,  and  the  Dale-Chall  Readability  Formula 
(Dale  &  Chall,  19^8)  was  used  for  the  fourth  through  seventh 
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grade  passages.  Also,  these  passages,  along  with  a  series  of 
MCC  passages  ranging  from  first  through  twelfth  grade  level, 
had  their  readability  level  determined  by  a  Rasch  calibrated 
scale.  The  Rasch  based  scale  Is  considered  to  be  a  "person- 
free"  estimate  of  passage  difficulties  (Kidder,  1977).  That 
Is,  calibrations  derived  from  the  Rasch  model  are  not  sample 
dependent.  For  further  Information  on  the  Rasch  model,  see 
Hambleton  and  Cook  (1977),  or  Wright  and  Panchapakesan  (1969). 

These  multiple  choice  passages  served  two  purposes. 
They  provided  a  check  on  the  readability  level  of  the  original 
passages  and  were  used  to  determine  whether  any  learning  took 
place  from  the  standard  cloze  passages  which  were  always 
administered  first.   Each  student  took  three  standard  cloze 
tests  and  three  Homan  Cloze  (MCC)  tests  on  the  same  stories. 
They  also  took  three  MCC  tests  (Kidder  Cloze)  on  different 
stories. 

If  learning  had  occurred  from  the  standard  cloze  tests, 
the  students  would  be  expected  to  score  higher  on  Homan  MCC 
tests  than  Kidder  MCC  tests.  The  standard  cloze  tests  and 
the  Homan  MCC  tests  were  identical  in  content,  differing  only 
In  form.   Therefore,  learning  from  the  standard  cloze  test 
would  very  likely  be  reflected  in  a  high  Homan  MCC  test  score. 
Source  of  Items 

The  Kidder  Cloze  passages  were  taken  as  complete  stories, 
The  Investigator  then  randomly  deleted  every  fifth  word  using 
the  same  procedure  used  for  the  original  MCC  passages.   The 


39 

sane  procedure  was  also  followed  for  selecting  the  two 

dlstractors. 

Reliability 

Some  of  the  Kidder  Cloze  passages  had  only  ten  items. 
Rufener  (1972)  achieved  stable  scores  after  only  ten  to 
twenty  cloze  deletions.   Using  cumulative  percentage  of  suc- 
cessful scores,  most  passages  indicated  stability  of  scores 
after  ten  to  fifteen  deletions. 

Using  internal  consistency  as  a  measure  of  reliability, 
the  Kidder  Cloze  passages  had  respectable  reliabilities, 
ranging  from  .65  to  .90  (see  Tables  lH,  15.  l6).   Based  on 
the  high  reliabilities  of  all  Kidder  Cloze  passages  and  the 
data  from  the  Rufener  (1972)  study,  it  seems  reasonable  to 
conclude  that  even  ten  cloze  items  can  yield  reliable  results. 
The  three  passage  scores  for  each  student  were  combined  for 
correlation  with  Homan  MCC.   The  combined  passage  reliabilities 
were  higher  than  the  individual  passage  reliabilities. 
Infornal  Reading  Inventory  (IHI) 

The  IRI  is  a  measure  of  a  student's  instructional 
reading  level.  Using  graded  passages,  a  measurement  is 
obtained  of  comprehension  and  word  recognition  scores. 

The  IRI  used  in  this  study  was  developed  by  Alexander 
(1968).   It  consists  of  a  series  of  graded  stories,  each  fol- 
lowed by  five  comprehension  questions  (see  Appendix  E).   The 
comprehension  questions  combined  questions  at  the  literal, 
inferential,  vocabulary,  and  evaluative  comprehension  levels. 
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Alexander  (1968)  developed  a  cloze  criteria  for  determining 
Instructional  reading  level  using  this  IRI. 

The  Powell  criteria  for  determining  Instructional  level 
from  IRI  scores  were  used.   However,  the  scores  were  also  eval- 
uated using  the  Betts  criteria.   Differences  when  using  each 
criteria  were  examined. 

Thlrty-slx  second  graders,  thirty-four  fourth  graders, 
and  thlrty-slx  sixth  graders  were  chosen  randomly  and  admin- 
istered an  IRI.   Informal  Reading  Inventory  scores  were  used 
as  the  criterion  to  validate  MCC  as  a  means  of  determining 
Instructional  reading  level. 
Procedure 

Each  class  at  all  levels  had  two  testing  sessions  of 
approximately  thirty  minutes  each.   The  first  session  always 
Involved  three  standard  cloze  passages.   In  half  of  the 
classes  the  Kidder  MCC  passages  were  also  administered  at  the 
first  session. 

The  second  testing  session,  which  was  always  at  least 
one  week  after  the  first  session,  involved  the  administration 
of  the  Homan  MCC  test.  Half  of  the  classes  were  administered 
the  Kidder  MCC  at  the  second  testing  session.  The  IRI's  were 
given  individually  after  both  testing  sessions  were  completed 
to  the  reduced  sample  (n=107). 

Second  grade  students  were  administered  standard  cloze, 
Homan  MCC,  and  Kidder  MCC  passages  at  the  first,  second,  and 
third  grade  readability  levels.   Fourth  grade  students  were 
administered  standard  cloze,  Homan  MCC,  and  Kidder  r:CC  passages 
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at  the  third,  fourth,  and  fifth  grade  readability  levels. 
Sixth  grade  students  were  administered  standard  cloze,  Konan 
MCC,  and  Kidder  MCC  passages  at  the  fifth,  sixth,  and  seventh 
grade  readability  levels. 

Administration 

All  tests  were  administered  by  the  investigator  to 
insure  unlforralty  of  instructions.   The  Instuctions  were 
given  orally.   A  standard  cloze  iten  was  demonstrated  on  the 
chalkboard.   The  example  for  second  grade  was:   THE  DOG  RAN 

TO  DOOR.   HE  WANTED  TO  IN.   The  fourth 

and  sixth  grade  example  was:   THE  Z'tllUG   V/ENT  BACK  

FORTH. 

There  was  no  time  limit  on  the  tests.   The  students 
were  permitted  to  ask  their  teacher  or  the  investigator  to 
spell  words,  but  words  could  not  be  pronounced  for  them. 
(For  full  directions,  see  Appendix  A.) 

Method  of  Analysis 

All  data  were  punched  onto  IBM  cards  for  subsequent 
analysis.   The  Statistical  Package  for  the  Social  Sciences 
(Nie,  Hull,  Jenkins,  Steinbrenner  t  Brent,  1970)  was  used  to 
facilitate  computation.   The  Bionedlcal  Computer  Programs, 
P-Series  (Dixon  &  Brown,  1977)  was  used  for  the  analysis  of 
variance  computation.   The  research  hypotheses  now  follow 
stated  in  null  form.   After  each  hypothesis  is  a  brief  expla- 
nation of  the  statistical  analysis  utilized. 
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Hypothesis  lA 

There  will  be  no  differences  between  the  mean  scores 
for  standard  cloze  and  MCC  passages  for  the  sane  group  of 
students. 
Hypothesis  IB 

There  will  be  no  differences  among  the  r.ean  scores  on 
the  three  levels  of  difficulty  tested  for  each  group. 
Hypothesis  IC 

There  will  be  no  Interaction  between  the  form  used 
(standard  cloze  or  MCC)  and  the  level  of  difficulty  (reada- 
bility level)  of  the  passage. 

Analysis  of  variance  v/as  applied  to  compare  the  standard 
cloze  scores  and  Homan  MCC  scores  for  the  same  students  using 
a  randomized  block  factorial  design  with  the  subjects  serving 
as  blocks.   The  students'  scores  on  the  three  standard  cloze 
tests  were  compared  to  their  scores  on  MCC  tests. 

Differences  due  to  form  (standard  cloze  and  P.CC) ,  and 
level  of  difficulty  were  tested.  The  degree  of  interaction 
between  form  and  level  was  examined. 

These  hypotheses  were  tested  at  a  significance  level  of 
a=.05.   Since  the  assumption  of  symmetry  for  the  varlance- 
covariance  matrix  was  not  tested,  a  conservative  F  test, 
the  Geisser-Greenhouse  test  (Kirk,  1968),  was  used  to  test 
significance  for  both  main  effects  and  the  interactions  at 
the  second,  fourth,  and  sixth  grade  level  analyses. 
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Hypothesis  II 

A  correlation  of  .70  or  more  exists  between  standard 
cloze  and  MCC. 

The  strength  of  the  relationship  between  standard  cloze 
scores  and  MCC  scores  was  assessed  using  the  Pearson  Product- 
Moment  correlation.   A  preset  correlational  value  of  .70  was 
used  to  determine  the  practical  significance  of  the  relationship. 
Hypothesis  ITTf. 

There  will  be  no  relationship  between  standard  cloze 
scores  and  IRI  scores. 
Hypothesis  IIIB 

There  will  be  no  relationship  between  MCC  scores  and 
IRI  scores. 

The  Pearson  Product-Moraent  correlation  was  computed  to 
assess  the  relationship  between  both  standard  cloze  and  MCC 
to  the  IRI. 

These  hypotheses  were  tested  at  a  significance  level  of 
o-.Ol.   The  a=.01  level  of  significance  was  chosen  because 
the  results  of  these  tests  may  determine  if  the  instruments 
Involved  will  be  used  for  placement.   When  considering  place- 
ment of  students  for  instructional  reading  level,  accuracy 
is  extremely  important.   The  significance  level  of  o=.01  was 
used  to  guard  against  a  Type  I  error.   All  hypotheses  that 
relate  to  possible  placement  decisions  were  tested  at  a 
significance  level  of  a=.01. 
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Hypothesis  II IC 

The  correlations  between  KCC  scores  and  IRI  Instruc- 
tional level  scores  will  be  the  same  as  the  correlations 
between  standard  cloze  and  IRI  Instructional  level  scores. 

The  difference  between  the  Pearson  Product -Moment 
correlation  coefficients  of  standard  cloze  and  MCC  to  the  IRI 
was  tested  for  significance  usinc  the  following  formula: 


(r 
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'13)      /  ^^'-3^  ^\="23^ 

^         2  (l-r^3-rj2-43^2r23r^2^,. 


where , 

r,2  is  the  correlation  coefficient  of  the  IRI  to  T'CC. 

r^.  Is  the  correlation  coefficient  of  the  IRI  to  SC. 

r.-,  is  the  correlation  coefficient  of  SC   to  MCC 

d.f.  -  N-3. 
This  formula  (Guilford  &  Fruchter,  1973)  is  used  to  test  for 
significance  between  correlation  coefficients  from  the  same 
sample. 
Hypothesis  IV 

Multiple  choice  cloze  passage  reliabilities  will  be  the 
same  as  standard  cloze  passage  reliabilities  at  the  same 
grade  level. 

The  Internal  consistencies  of  all  instruments  were 
estimated  using  the  Gitap  Program  (Baker,  1970).   Hoyt  relia- 
bility coefficients  are  computed  by  this  program.   Item  dif- 
ficulties and  biserial  correlations  were  also  provided  by 
this  program. 
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Hypothesis  V 

There  will  be  no  relationship  between  total  Homan  KCC 
scores  and  total  Kidder  Cloze  scores.   Total  cloze  scores 
are  the  students'  combined  scores  on  all  three  Koman  Cloze 
or  Kidder  Cloze  passages. 

The  relationship  between  Homan  MCC  scores  and  Kidder 
MCC  scores  was  assessed  by  the  Pearson  Product-Moment  corre- 
lation method.   This  hypothesis  was  tested  at  a  significance 
level  of  a". 01 
Hypothesis  VIA 

There  will  be  no  relationship  between  IF.I's  instruc- 
tional level  scores  as  scored  by  the  Powell  and  Betts  criteria. 

The  relationship  between  instructional  level  scores 
from  the  IRI  as  scored  by  the  Powell  criteria  and  the  Betts 
criteria  was  assessed  by  computing  the  Pearson  Product-Moment 
correlation.  The  hypothesis  was  tested  at  a  significance 
level  of  a=.01. 
Hypothesis  VIE 

There  will  be  no  difference  between  instructional  level 
means  as  scored  by  the  Powell  and  Betts  criteria. 

The  difference  between  instructional  level  means  as 
determined  by  the  Powell  and  Betts  criteria  was  tested  by  a 
t-test  for  comparison  of  means.   The  hypothesis  was  tested 
at  a  significance  level  of  a=.01. 
Hypothesis  VIC 

When  the  Powell  and  Betts  criteria  do  not  place  students 
at  the  same  instructional  level,  a  greater  proportion  of 
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students  will  be  placed  at  a  higher  Instructional  reading 
level  by  the  Powell  criteria  than  the  Betts  criteria. 
Hypothesis  VIP 

Students  will  be  placed  at  the  same  Instructional  level 
by  the  Powell  and  Betts  IRI  criteria  at  least  75  percent  of 
the  time. 

The  number  of  times  the  Powell  criteria  would  place 
students  at  the  same  instructional  level  was  calculated  by 
hand  and  reported  in  percentages.   A  Chi  Square  test  was  used 
to  test  the  significance  of  the  differences  In  proportions 
of  students  placed  at  the  higher  instructional  level  by  the 
Powell  and  Betts  criteria,  respectively. 


CHAPTER  IV 

RESULTS,  DISCUSSION  AKD 

THEORETICAL  CONSIDERATIONS 


Results  and  Discussions 


The  major  purpose  of  this  study  was  to  Investigate  the 
relationship  between  standard  cloze  and  rCC  tests.   Several 
hypotheses  were  tested  In  this  regard. 

A  secondary  purpose  of  the  study  Involved  a  comparison 
of  readability  levels  as  determined  by  traditional  methods 
and  a  new  system  of  readability  determination,  Rasch  cali- 
bration (Kidder,  1977).  A  third  aspect  of  this  study  Involved 
the  IRI  and  the  two  types  of  scoring  criteria  used  with  the 
IRI  to  determine  instructional  reading  levels. 

The  results  for  the  testing  of  each  hypothesis  will  be 
presented,  followed  by  a  discussion  of  those  results.  The 
first  hypothesis  had  the  following  components: 

Hypothesis  lA  -  There  will  be  no  differences  between 
the  mean  scores  for  standard  cloze  and  MCC  passages  for  the 
same  group  of  students. 

Hypothesis  IB  -  There  will  be  no  differences  among  the 
mean  scores  on  the  three  levels  of  difficulty  tested  for  each 
group. 


47 


18 

Hypothesis  IC  -  There  will  be  no  Interaction  between 
the  form  used  (standard  cloze  or  KCC)  and  the  level  of  diffi- 
culty (readability  level)  of  the  passages. 

Mean  scores  ar.d  standard  deviations  by  grade  and  test 
are  shown  in  Table  1. 

A  randomized  block  factorial  design  was  used  to  test 
the  four  parts  of  the  first  hypothesis.   Each  student  was 
tested  on  the  sar.e  six  measures.   The  factors  involved  in  the 
analysis  were  test  fom  and  difficulty  level.   Test  form 
consisted  of  two  types  of  tests,  standard  cloze  and  MCC. 
Passage  difficulty  consisted  of  three  consecutive  grade  levels. 
Separate  analyses  were  conducted  for  grades  two,  four,  and 
six.  The  analysis  of  variance  (AMOVA)  tables  for  these  anal- 
yses are  presented  in  Tables  2,3,  and  4,  respectively. 

A  significant  interaction  between  test  form  and  passage 
difficulty  was  present  in  grades  two,  four,  and  six.   Hypo- 
thesis IC  was  rejected-   Because  the  interaction  was  signifi- 
cant. Simple  Main  Effects  were  calculated  to  determine  more 
accurately  where  the  significant  differences  were  present. 
Tables  5,  6,  and  7  show  the  Simple  Main  Effects  summary 
tables  for  grades  two,  four,  and  six,  respectively. 

The  tests  for  Simple  Main  Effects  at  all  three  grades 
indicated  all  effects  studied  were  significant.   These 
findings  actually  cean  that  for  the  level  one  passage,  or  the 
lowest  readability  level  given  to  each  group  (first  grade 
level  for  the  second  grade  group,  third  grade  level  for  the 
fourth  grade  group,  and  fifth  grade  level  for  the  sixth  grade 


Table  1 


Means  on  Standard  Cloze  and  HCC  for 
Grades  Two,  Four,  and  Six 
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Grade 

Test 

Passage 

Level  1 

Passaee 
Level  2 

Passage 

Level  3 

N 

Grade  2 

SC 

10.6 

6.7 

^.0 

181 

Grade  2 

MCC 

15.8 

17.1 

13.3 

181 

Grade  4 

SC 

9.5 

7.9 

6.4 

168 

Grade  4 

MCC 

20.3 

19.8 

17.6 

168 

Grade  6 

SC 

12. U 

8.7 

7.3 

196 

Grade  6 

MCC 

21. H 

21.0 

18.1 

196 

50 


Table  2 


Analysis  of  Variance  Abbreviated  Sumr:ary 
Table  for  Grade  Two 


Source 

df 

1 

SS 

MS 

F 

Test  Form 

18712.32 

18712.32 

icjg 

99» 

Passage 

Difficulty  Level 

2 

iioig.so 

2009.90 

107 

30* 

Test  Form  by 

Difficulty  Level 

2 

1297.19 

648. 7'» 

32 

16* 

Test  Form  by 
Student 

180 

3207.86 

17.82 

Difficulty  Level 
by  Student 

360 

67H3.10 

13.73 

Test  Form  by 

Difficulty  Level 
by  Student 

360 

7262.51 

20.17 

»p  <  .05 

^The  abbreviated  summary  table  contains  only  the  factors 
Involved  In  the  testing  of  Hypotheses  lA,  IB,  and  IC. 
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Table  3 

Analysis  of  Variance  Abbreviated  Summary 
Table  for  Grade  rour 


Source 

df 

1 

S£ 

MS 

F 

Test  Form 

3227e.8'J 

32276.84 

2118 

31» 

Passage 

Difficulty  Level 

2 

1472. C6 

736.03 

104 

28» 

Test  Form  by 

Difficulty  Level 

2 

52.71 

26.36 

4 

29» 

Test  Form  by 
Student 

167 

2514.59 

15.24 

Difficulty  Level 
by  student 

334 

2357.51 

7.06 

Test   Form  by 

Difficulty   Level 

by  Student  334  2054.25  6.15 


•p<.05 

•^The  abbreviated  summary  table  contains  only  the  factors 
Involved  In  the  testing  of  Hypothesis  lA,  IB,  and  IC. 
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Table  ^ 

Analysis  of  Variance  Abbreviated  Sunrary 
Table  for  Grade  Six 


Source 

df 

1 

SS 

MS 

F 

Test  Form 

33685.16 

33685. 

,16 

JJ060, 

,82» 

Passage 

Difficulty  Level 

2 

35')5.19 

1772. 

.59 

357. 

.71« 

Test  Forra  by 

Difficulty  Level 

2 

572.2') 

286. 

,12 

58. 

,76» 

Test  Forra  by 
Student 

195 

1617.56 

8. 

.23 

Difficulty  Level 
by  Student 

390 

1932.60 

1. 

.96 

Test  Form  by 

Difficulty  Level 

by  Student         390     1902.38        'J. 89 


»p  <  ,05 

^^Tbe   abbreviated  summary  table  contains  only  the  factors 
Involved  In  the  testing  of  Hypotheses  lA,  IB,  and  IC. 
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Table  5 
Simple  Main  Effects  for  Grade  Two 


Source 

df 

1 

SS 

MS 

F 

Form  at  Level 

1 

2519 

m 

2519. 'fl 

129.93* 

Form  at  Level 

2 

1 

9722 

03 

9722.03 

501.39* 

Form  at  Level 

3 

1 

7768 

86 

7768.86 

i*00.66» 

Level  at  SC 

2 

39')'* 

00 

1972.00 

101.39* 

Level  at  MCC 

2 

1373 

38 

686.69 

35.31* 

•p  <  .05 
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Table  6 

Simple  Main  Effects  for  Grade  Four 


Source 

3 

df 

1 

SS 

MS 

F 

Form  at  Level 

9793. '<'4 

9793 

4i| 

1066.82* 

Form  at  Level 

4 

1 

11916.67 

11917 

67 

1298.11* 

Form  at  Level 

5 

1 

10620.00 

10620 

00 

1156.86* 

Level  at  SC 

2 

836.91 

itlB 

i)6 

63. fO* 

Level  at  MCC 

2 

687. 9'J 

3'<3 

97 

52.11* 

p  <  .05 
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Table  7 
Simple  Kaln  Effects  for  Grade  6 


Source 

df 

1 

SS 

MS 

P 

Form  at  l^vel 

5 

78118.25 

78H8 

25 

1303. 70« 

Form  at  Level 

6 

1 

11976.85 

11976 

85 

2137. 35* 

Form  at  Level 

7 

1 

111)32,88 

11132 

38 

1399. 15* 

Level  at  SC 

2 

2811.99 

1106 

00 

235.78» 

Level  at  7,CC 

2 

1305.62 

652 

81 

132.69* 

•p  <  .05 
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group),  significant  differences  were  observed  between  student 
scores  on  standard  cloze  tests  and  MCC  tests.   The  same  is 
also  true  at  the  other  two  grade  levels  at  which  the  students 
were  tested.   The  form  of  the  test,  standard  cloze  or  MCC, 
made  a  significant  difference  for  all  three  grades  at  all 
readability  levels  exanined.   Thus,  Hypothesis  lA  was  rejected. 

For  all  three  samples  (second,  fourth,  and  sixth  graders) 
the  Simple  Main  Effects  test  also  indicated  significant  dif- 
ferences among  mean  scores  on  the  three  passage  difficulty 
levels.   Therefore,  Hypothesis  IB  was  rejected.   Since  three 
passage  difficulty  levels  v;ere  tested  on  each  test  form,  a 
further  test  was  necessary  to  determine  exactly  which  level 
scores  were  significantly  different  within  each  form. 

Tukey's  test  for  differences  in  means  was  used  to  make 
this  determination  (Hays,  1973).   The  differences  in  means 
were  tested  for  significance  at  the  .05  level.   Tukey's  test 
results  are  presented  in  Tables  8,  9,  and  10. 

For  the  second  grade,  on  the  standard  cloze  test  and 
the  MCC  test,  all  of  the  mean  scores  were  significantly 
different  from  each  other.   In  other  words,  the  first  level 
mean  scores  were  significantly  different  from  the  second  and 
third  level  scores,  and  the  second  level  mean  scores  were 
significantly  different  from  the  third  level  mean  scores. 

For  the  fourth  grade,  the  standard  cloze  mean  scores 
were  all  significantly  different  on  passages  of  different 
difficulty.   The  MCC  mean  scores  on  passages  of  different 
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Table  8 


Tukey's  Test  for  Differences  in 

Means  for  Standard  Cloze  Scores 

and  HCC  Scores  for  Grade  Two 


Standard  Cloze  ± — 

Difficulty  Level  1  10.56 
Difficulty  Level  2  6-71 

Difficulty  Level  3  3.99 


1 

2 

3 

1 

3.85* 

6.57* 

2 

2,72» 

3 

V   l8l 


HSD^05  »  3.31  \l    iff^   =  1.09 


Multiple  Choice  Cloze  i 

Difficulty  Level  1  15-83 

Difficulty  Level  2  17.07 

Difficulty  Level  3  13-25 

2       1    3 


2 

1.2'*» 

3.82» 

1 

2.58» 

3 

HSD_o5  -  3.31  K/  ^^^       =  l-°9 


^MS  ERROR  =  pooled  error  terms  for  difficulty  level  and 
test  form  by  difficulty  level. 


Table  9 
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Tukey's  Test  for  Differences  In 

Means  for  Standard  Cloze  Scores 

and  MCC  Scores  for  Grade  Four 


Standard  Cloze 

Difficulty  Level  3 
Difficulty  Level  'J 
Difficulty  Level  5 
1       2 3 


1 

1.67* 

3.16» 

2 

l.H9» 

3 

»SD.o5  ■  3-31  y  TtW- 

Multlple  Choice  Cloze 

Difficulty  Level  3 

Difficulty  Level  <( 

Difficulty  Level  5 

1       2       3 

1 

.55    2.70» 

2.15* 


HSD 


.05 


3.31 


V^ 


6.6 
iM 


=  .656 


=  .656 


X 
9.51 
7.87 
6.83 


20 

33 

19 

78 

17 

63 

■^MS  ERROR  =  pooled  error  terms  for  difficulty  level  and 
test  form  by  difficulty  level. 


Table  10 
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Tukey's  Test  for  Differences  In 

Means  for  Standard  Cloze  Scores 

and  MCC  Scores  for  Grade  Six 


Standard  Cloze 

Difficulty  Level  5 
Difficulty  Level  6 
Difficulty  Level  7 

1       2 3 


HSD 


05 


3.31 


4.92 


1 

3.77*   5. 17* 

2 

l.i)0» 

3 

HS 

°.05  "  ^'^^      V  1$^ 

Multiple  Choice  Cloze 

Difficulty  Level  5 

Difficulty  Level  6 

Difficulty  Level  7 

1      2      3 

1 

.36    3.32* 

2 

2.96* 

3 

=  .521 


.521 


12 

^^ 

8 

67 

7 

27 

21.39 
21.03 
18,07 


^MS  ERROR  »  pooled  error  terms  for  difficulty  level  and 
test  form  by  difficulty  level. 
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difficulty  were  significantly  different  between  levels  three 
and  five,  and  levels  four  and  five. 

The  results  for  the  sixth  grade  group  for  the  standard 
cloze  test  Indicated  significant  differences  between  the  mean 
scores  for  all  passage  levels. 

In  the  MCC  form  situation,  there  were  two  significant 
differences  between  mean  scores.   The  fifth  grade  level  pas- 
sage mean  score  was  significantly  different  from  the  seventh 
grade  level  mean  scores,  and  the  sixth  grade  level  mean 
scores  were  significantly  different  from  the  seventh  grade 
level  mean  scores. 

In  review,  significant  differences  due  to  test  form 
were  observed  at  all  three  grade  levels.   Significant  differ- 
ences between  passages  did  exist  for  each  test  form  between 
most  grade  levels. 

Hypothesis  II  stated  that  a  correlation  of  .70  or  more 
exists  between  standard  cloze  and  MCC.   A  correlation  of  .70 
or  more  would  be  necessary  to  indicate  a  practical  significance 
of  the  relationship  of  these  two  variables. 

Tables  11,  12,  and  13  depict  the  correlation  coefficients 
for  cloze  tests  at  grades  two,  four,  and  six,  respectively. 

Hypothesis  II  predicted  a  strong  relationship  (.70  or 
more)  would  exist  between  standard  cloze  and  MCC.   Hypothesis 
II  was  not  supported  at  grade  four  or  grade  six.   For  second 
grade,  second  level,  the  correlation  was  .80.   It  was  expected 
that  the  scores  on  the  identical  story  given  to  the  same  stu- 
dents would  correlate  highly,  despite  the  differences  in  forms. 
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Table  11 


Second  Grade  Correlations  of  Cloze  Tests 


Total 
SCTl   SCT2   SCT3   HCCTl   MCCT2   MCCT3    SO 


Total 

•ACC 


Total 
KG 


Total 
KC 


1.0 


Underline  Indicates  practical  significance  (-70). 
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Table  12 
Fourth  Grade  Correlations  of  Cloze  Tests 


Total 
SCTl   SCT2   SCT3   MCCTl   MCCT2   MCCT3    ^C 


Total 

acc 


Total 
KC 


Total 

KCC 

.68 
.71 
.59 
.37 
.93 
.91 

.73 

1.0 


rotal 

KC 

.71 
.67 
.52 

.72 
.71 

.70 

.80 

1.0 


Underline  Indicates  practical  significance  (.70)- 
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Table  13 
Sixth  Grade  Correlations  of  Cloze  Test  Scores 


Total 
SCTl   SCT2   SCT3   ImCCTI   MCCT2   MCCT3   _SC 


SCTl 

1.^ 

^65 

.62 

SCT2 

X, 

.59 

SCT3 

hJ 

MCCTl 

HCCT2 

MCCT3 

Total 
SC 

Total 
HCC 

Total 
KC 


Total 
MCC 


rotal 

<c 


.89 

.63 

.62 

.86 

.51 

.51 

.84 

.58 

.51 

.47 

.76 

.60 

.60 

.90 

.73 

.60 

.an 

.63 

1.0 

.67 

.64 

1.0 


.79 
1.0 


Underline  Indicates  practical  significance  (.70)' 
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It  should  be  noted,  however,  correlations  between  total  scores 
over  three  passages  were  .78,  .73,  and  .67  for  grades  two, 
four,  and  six,  respectively. 

The  fact  that  the  correlations  for  the  sane  stories 
were  so  low.  In  some  Instances  Indicating  a  shared  variance 
of  less  than  8  percent,  suggests  that  standard  cloze  and  HCC 
may  not  measure  the  sane  thing.   A  shared  variance  of  less 
than  8  percent  Indicates  that  less  than  8  percent  of  the 
variance  In  scores  of  MCC  can  be  explained  by  variance  In 
standard  cloze  scores. 

To  further  Investigate  the  relationship  between  MCC 
test  scores  and  standard  cloze  test  scores  the  correlational 
information  was  examined  using  the  multltralt-multlmethod 
matrix  suggested  by  Campbell  and  Flsk  (1959). 

The  MCC  and  standard  cloze  score  correlations  for  the 
same  passage  level  were  considered  to  be  correlations  between 
measures  of  the  same  trait  using  different  r.ethods.   These 
correlations  are  called  the  convergent  validity  coefficients. 
Campbell  and  Flsk  reason  that  such  correlations  should  be 
greater  than  the  correlations  between  measures  of  different 
traits  with  different  methods  (I.e.,  MCC  and  standard  cloze 
score  correlations  for  different  passage  levels). 

The  second  grade  correlations  for  the  diagonal  (same 
passage-different  method)  ranged  from  .h6   to  .56.   If  the  two 
methods  (MCC  and  standard  cloze)  measured  the  same  construct, 
these  correlations  should  exceed  the  correlations  located 
within  the  dotted  line  triangles.   Similarly,  diagonal 
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correlations  should  at  least  equal  the  values  contained  v;lthln 
the  solid  triangles  (correlations  between  different  passages 
using  same  method).   These  ranged  from  .^^   to  .69.   The 
different  method-different  passage  correlations  ranged  from 
.39  to  .56. 

The  ranges  of  the  correlations  In  Table  13  were  similar 
enough  to  question  whether  standard  cloze  and  HCC  measure  the 
same  or  Independent  constructs.   The  second  grade  correlations 
were  so  close  In  range  that  the  question  of  whether  standard 
cloze  and  MCC  both  measure  reading  comprehension  cannot  be 
proven  or  dlsproven. 

The  fourth  grade  test  score  correlations  for  different 
method-same  passage  ranged  from  .56  to  .6H.      The  same  method- 
different  passage  correlations  ranged  from  .62  to  .79.   The 
different  method-different  passage  correlations  ranged  from 
.51  to  .64.   At  this  grade  level  also  the  range  of  correla- 
tions were  too  similar  to  determine  Independence  or  strong 
relationship  of  measured  constructs. 

The  sixth  grade  test  score  correlations  for  different 
method-same  passage  ranged  from  .^6   to  .56.   The  same  method- 
different  passage  correlations  ranged  from  .^k    to  .67.   The 
different  method-different  passage  correlations  ranged  from  .35 
to  .56.   In  this  case,  also,  the  ranges  of  the  correlations 
were  too  close  to  conclude  whether  standard  cloze  and  MCC  were 
measuring  like  or  different  constructs.   The  similarities  of 
the  range  of  correlations  also  preclude  any  strong  statements 
reflecting  that  standard  cloze  and  MCC  do  or  do  not  both 
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measure  reading  comprehension,  or  the  sane  type  of  reading 
comprehension.   Additional  study  In  this  area  might  help  to 
clarify  this  situation. 

Guthrie  (.19Ti)   suggested  the  use  of  Maze  Technique  (a 
MCC  form  developed  In  the  same  way  as  Homan  MCC)  to  determine 
reading  comprehension  and  If  a  book  Is  at  a  suitable  Instruc- 
tional level  for  a  student.   Standard  cloze  has  long  been 
regarded  as  a  measure  of  reading  comprehension  (Eormuth,  1969; 
Horton,  1975;  Rankin,  1959).   Some  question  has  been  raised, 
as  evidenced  by  the  current  study,  concerning  whether  or  not 
MCC  and  standard  cloze  tests  measure  the  same  thing.   Perhaps 
Guthrie's  contention  that  Maze  or  MCC  measure  reading  compre- 
hension should  be  reevaluated  and  investigated  further. 

Informal  Reading  Inventory  scores  correlated  more  highly 
with  standard  cloze  scores  than  MCC  scores  (Table  13)  at  the 
sixth  grade  level,  again  indicating  that  MCC  or  Maze  may  not 
be  measuring  reading  comprehension. 

Guthrie  (197't)  suggested  that  the  amount  of  items 
correct  is  the  student's  percentage  of  amount  of  comprehension 
on  any  given  Maze  passage.   In  light  of  the  present  study, 
this  seems  unlikely.  Additional  study  is  called  for  to  deter- 
mine what  MCC  is  measuring.   If  it  is  measuring  reading  com- 
prehension, is  it  a  different  type  of  comprehension  than  that 
measured  by  standard  cloze  tests  and  the  IRI? 

The  fourth  grade  correlations  between  standard  cloze 
and  MCC  scores  were  the  highest  of  the  three  grade  levels. 
However,  even  these  scores  fell  short  of  the  .70  value  of 
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practical  significance.  Most  of  the  correlations  at  all 
three  grades  Indicated  approximately  28  percent  to  30  percent 
shared  variance. 

The  value  of  .70  was  chosen  because  It  would  indicate 
19  percent  shared  variance;  that  is,  almost  50  percent  of  the 
variance  In  MCC  scores  could  be  explained  by  standard  cloze 
scores.   If  they  had  less  variance  in  common,  it  would  not 
seem  prudent  to  set  up  a  new  criteria  for  determining  instruc- 
tional level  with  MCC  from  standard  cloze  scores. 

The  total  score  correlations  were  much  higher  than 
those  of  the  Individual  test  scores.  The  total  scores  were 
obtained  by  using  combined  total  scores  across  the  three 
levels  tested  at  each  grade.   For  example,  at  the  second 
grade  level  the  total  standard  cloze  score  was  the  combined 
score  on  passages  one,  two,  and  three. 

These  total  correlations  were  about  .70  in  both  second 
and  fourth  grades.  The  correlation  neared  practical  signifi- 
cance In  sixth  grade  with  a  .Cl   correlation  between  standard 
cloze  and  MCC  scores.   This  suggests  some  value  in  giving 
three  passages  to  each  student.   The  time  involved  in  the 
testing  procedure  would  be  tripled.   By  extending  the  testing 
time,  much  of  the  value  of  standard  cloze  and  IICC  would  be 
lost  for  the  classroom  teacher. 

Null  Hypothesis  III  was  in  three  parts.   In  the  first 
two  parts  It  stated  that  there  would  be  no  relationship 
between  standard  cloze  scores  and  IP.I  scores  or  between  IRI 
and  MCC  scores. 


68 

Table  1^   contains  the  IRI,  standard  cloze,  and  r.CC 
correlations  for  the  second,  fourth,  and  sixth  grades.   The 
Powell  differentiated  criteria  (Powell,  1978)  were  used  to 
score  the  IRI's. 

Hypothesis  IIIA  stated  there  would  be  no  relationship 
between  standard  cloze  scores  and  IPI  scores.   Hypothesis 
IIIB  stated  the  same  thing  for  MCC  scores  and  IRI  scores. 
However,  In  many  Instances,  that  was  not  the  case. 

In  the  second  grade  data  the  IRI  correlated  signifi- 
cantly with  the  standard  cloze  level  one  passage  and  the  MCC 
third  level  passage.   The  other  correlations  were  not  signifi- 
cant at  the  a=.oi  level. 

None  of  the  fourth  grade  tests,  standard  cloze  or  MCC, 
correlated  significantly  with  the  IRI  scores.   In  the  sixth 
grade  the  fifth  level  MCC  did  not  correlate  significantly 
with  the  IRI  scores.   The  seventh  level  MCC  scores  were  very 
close  to  a  significant  correlation.   All  other  sixth  grade 
tests  did  correlate  significantly  with  the  IRI  scores  (a=.01). 

Hypotheses  IIIA  and  IIIB  were  rejected  for  grades  two 
and  six,  but  these  null  hypotheses  were  not  rejected  for  grade 

four. 

The  third  part  of  Hypothesis  III  stated  that  correlations 
between  MCC  scores  and  IRI  instructional  level  scores  would 
be  the  same  as  correlations  between  standard  cloze  and  IRI 
instructional  level  scores.   The  significance  of  the  differ- 
ences in  correlations  was  determined  by  using  the  formula  for 
comparison  of  correlation  coefficients  from  the  sane  sample 
(Guilford  &  Fruchter,  1973;  Hotelllng,  19'tO). 


69 


Table  Ik 


Correlations  of  Informal  Reading  Inventory 

Instructional  Level  Scores  v;ith  Standard 

Cloze  Scores  and  Multiple  Choice  Cloze 

Scores  for  Grades  Two,  Four,  and  Six 


Grade  Two  _N_  IRI  SCTl  SCT2  SCT3  MCCTl  MCCT2  MCCTB 

IRI  33  1.0  ^  .32  .07  .16  .12  .75 

Grade  Four  Ji_  IRI  SCT3  SCTt  SCT5  MCCT3  MCCT4  r-:CCT5 

IHI  30  1.0  .25  .33  .32  .27  .21  .17 

Grade  Six  Ji.  IRI  SCT5  SCT6  SCT7  'ACC75  'ACCTS  MCCT7 

IRI  31  1.0  .51  ^52  JO  -.08  _^  .38 


Underline  indicates  p<.01. 


(r^2-^13^ 


/(N-3)  (l  +  r23) 
2  (l-r^3-rj2-''i3-^2-"23  ^1 
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Mbere, 

r,p  Is  the  correlation  between  IHI  and  'ACC. 
r,.  Is  the  correlation  between  IRI  and  standard  cloze. 
Tp^  Is  the  correlation  between  'ACC   and  standard  cloze. 
d.f.  Is  N-3. 

The  results  of  this  test  for  significance  were  mixed. 
In  the  second  grade  standard  cloze  scores  correlations  with 
the  IRI  were  significantly  different  from  MCC   correlations 
with  the  IRI  at  all  three  passages  (o=.01).   However,  In  pas- 
sage levels  one  and  two,  standard  cloze  correlations  were 
blsher,  while  in  passage  level  three,  the  'ACC   correlation  was 
higher.   This  was  possibly  due  to  the  extrer.ely  low  scores 
Ban;  second  graders  received  on  the  standard  cloze  third  grade 
level  passage.   It  was  very  frustrating  for  r.any  of  them. 

Hypothesis  IIIC  was  not  accepted  for  all  three  passages 
of  the  second  grade  test.   It  should  be  noted,  however,  that 
standard  cloze  correlations  were  higher  at  levels  one  and 

tMO. 

The  fourth  grade  passages  showed  no  significant  differ- 
ences (<»  =  .01)  at  any  passage  level.   Therefore,  Hypothesis 
IIIC  was  accepted  for  the  fourth  grade  level  passages.   There 
was  no  significant  difference  between  standard  cloze  correla- 
tions to  IRI  scores  and  MCC  correlations  to  the  IRI. 
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The  sixth  grade  results  were  mixed.   On  the  fifth 
grade  level  passage  the  standard  cloze  correlation  with  IRI 
was  significantly  greater  than  the  KCC  correlation  to  the 
IRI-   However,  on  the  other  two  passages  (level  six  and  seven) 
the  correlations  were  not  significantly  different  (a=.01). 
Hypothesis  IIIC  was  not  accepted  for  level  five  of  the  sixth 
grade  passages.   It  was  accepted  for  levels  six  and  seven 
where  no  significant  differences  were  Indicated  between  corre- 
lations of  1-;CC  and  IRI  scores  and  standard  cloze  and  IRI 
scores. 

Hypothesis  IV  states  that  nCC  passage  reliabilities 
will  be  the  sane  as  standard  cloze  passage  reliabilities  at 
the  same  grade  level.   Tables  15,  16,  and  17  list  the  passage 
reliabilities,  the  range  of  item  difficulties,  blserlal  corre- 
lations, and  standard  error  of  measurement  for  the  second, 
fourth,  and  sixth  grade  tests,  respectively. 

These  results  indicated  Hypothesis  IV  was  not  accepted. 
At  all  levels  for  all  three  grades  the  MCC  test  reliabilities 
were  higher  than  the  standard  cloze  test  reliabilities  at  the 
saune  passage  level.  All  passages  at  all  levels  showed  high 
reliabilities.  However,  the  sixth  grade  passages.  In  some 
Instances,  had  lower  reliabilities  than  the  second  and  fourth 
grade  passages. 

The  reliabilities  were  a  measure  of  Internal  consistency. 
The  high  reliabilities  indicated  that  a  large  n^^ber  of  Items 
on  a  test  were  measuring  the  same  thing. 
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Table  15 


Passage  Reliabilities,  Standard  Errors  of 

Measurement,  Item  Difficulties,  and 

Blserlal  Correlations  for  all  Cloze 

Tests  for  the  Second  Grade 


Reliability 

SE 

Range 

of  Item 

Difficulty 

Range  of 

Elserlal 

Correlations 

SCTl 

.87 

1.61 

.19 

- 

.83 

.46 

- 

1.0^ 

SCT2 

.89 

1.56 

.00 

- 

.65 

.00 

- 

.96 

SCT3 

.89 

1.30 

.00 

- 

.38 

.00 

- 

.99 

HMCCTl 

.93 

1.0'* 

.71 

- 

.92 

.32 

- 

1.0^ 

HMCCT2 

.91 

1.61 

.57 

- 

.87 

.65 

- 

1.0^ 

HMCCT3 

.91 

1.87 

.28 

- 

.69 

.50 

- 

.98 

KCTl 

.90 

1.50 

.5t 

- 

.86 

.55 

- 

1.0^ 

KCT2 

.89 

1.25 

.57 

- 

.81 

.61 

- 

1.0^ 

KCT3 

.80 

1.21 

.H2 

- 

.75 

.56 

- 

.92 

TKC 

.95 

2.43 

.42 

- 

.86 

.47 

- 

.98 

^alue  larger  than  1.0  possibly  due  to  a  violation  of  the 
assumption  of  a  normal  distribution. 
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Table  l6 


Passage  Reliabilities,  Standard  Errors  of 

Measurement,  Item  Difficulties,  and 

Blserlal  Correlations  for  all  Cloze 

Tests  for  the  Fourth  Grade 


Range 
of  Item 

Range  of 
Blserlal 

Reliability 

SE 

Difficulty 

Correl 

atlons 

SCT3 

.83 

1.69 

.00 

- 

.an 

.00 

- 

.95 

SCTH 

.85 

1.65 

.00 

- 

.73 

.00 

- 

.95 

SCT5 

.89 

1.58 

.00 

- 

.66 

.00 

- 

.97 

HMCCT3 

.91 

1.22 

.70 

- 

.95 

.63 

- 

i.o'* 

HHCCT4 

.92 

1.32 

.65 

- 

.95 

.68 

- 

1.0*^ 

HMCCT5 

.92 

1.58 

.49 

- 

.87 

.38 

- 

1.0^ 

KCT3 

.79 

.80 

.73 

- 

.95 

.80 

- 

i.o'^ 

KCTi 

.78 

.99 

.63 

- 

.91 

.59 

- 

1.0^ 

KCT5 

.79 

.90 

.58 

- 

.91 

.66 

- 

1.0^ 

TKC 

.91 

1.63 

.58 

- 

.95 

.45 

- 

1.0^ 

^alue  larger  than  1.0  due  possibly  to  a  violation  of  the 
assumption  of  a  normal  distribution. 
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Table  17 


Passage  hellabllltles ,  Standard  Errors  of 

MeasureCienl ,  Item  Difficulties,  and 

Biserial  Correlations  for  all  Cloze 

Tests  for  the  Sixth  Grade 


Reliability 

SE 

Range 

of  Item 

Difficulty 

Range  of 

Biserial 

Correlations 

SCT5 

.75 

1.80 

.00 

- 

.93 

.00  - 

.91 

SCT6 

.70 

1.80 

,01 

- 

.9'* 

.06  - 

.8H 

SCT7 

.69 

1.65 

.00 

- 

.82 

.00  - 

.77 

HMCCT5 

.88 

1.00 

.68 

- 

.99 

.65  - 

1.0^ 

HI1CCT6 

.92 

1.06 

.83 

- 

.96 

.62  - 

1.0^ 

HMCCT7 

.81 

1.28 

AO 

- 

.96 

.30  - 

1.0^ 

KCT5 

.67 

.51 

.86 

- 

.99 

.86  - 

1.0^ 

KCT6 

.82 

.'•9 

.87 

- 

.99 

.96  - 

1.0^ 

KCT7 

.65 

.98 

.21 

- 

.98 

.35  - 

1.0^ 

TKC 

.85 

1.28 

.21 

- 

.99 

.21  - 

i.o'^ 

^alue  larger  than  1.0  due  possibly  to  a  violation  of  the 
assumption  of  a  norraal  distribution. 
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In  all  three  gradec,  for  all  passages,  the  Honan  "^CC 
passages  had  higher  reliabilities  than  the  standard  cloze 
passages.   Hypothesis  IV  v/as  not  supported.   Homan  MCC  pas- 
sage reliabilities  were  higher  than  standard  cloze  passage 
reliabilities. 

The  range  of  Item  difficulties  In  many  Instances 
(Tables  15,  16,  and  17)  was  very  broad.   In  sone  cases,  the 
MCC  Item  difficulties  were  very  high.   The  sixth  grade  'ACC 
Item  difficulties  for  passages  five  and  six  ranged  from  .86 
to  .99.  This  Indicates  that  all  the  Items  were  too  easy  and 
that  almost  all  students  were  able  to  get  almost  all  Items 
correct.   When  many  students  get  very  high  scores  it  is  very 
difficult  to  differentiate  between  students'  abilities. 

The  blserlal  correlations  between  the  individual  item 
scores  and  the  total  test  scores  were  varied.   They  tended 
to  cover  the  total  range  of  possible  correlations. 

Hypothesis  V  in  the  null  form  stated  that  there  was  no 
relationship  between  total  Homan  T'CC  scores  and  total  Kidder 
MCC  scores.   Pearson  Product-Moment  correlations  were  used  to 
determine  the  strength  of  the  relationship.   Table  18  presents 
the  results  of  these  correlations  for  second,  fourth,  and 
sixth  grades. 

Hypothesis  V  was  rejected  for  all  grade  levels.   A 
significant  relationship  (o».01)  did  exist  between  total  Homan 
MCC  scores  and  total  Kidder  MCC  scores. 

Total  scores  were  used  in  this  correlation  due  to  the 
shortness  of  some  of  the  Kidder  passages.   In  many  Instances 
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Table  18 


Correlations  of  Homan  Multiple  Choice  Cloze 

Total  Scores  and  Kidder  Multiple  Choice 

Total  Scores  for  the  Second,  Fourth, 

and  Sixth  Grades 


Grade  2 
Total 
HMCC 

Grade  2 
Total 
KMCC 

Grade  li 
Total 

re-icc 

Grade  4 
Total 
KMCC 

Grade  6 
Total 

KMCC 

Grade  6 
Total 

KMCC 

Grade  2 
Total 
race 

1.0 

.82 

Grade  2 
Total 
KMCC 

_ 

1.0 

Grade  1 
Total 
HMCC 

_ 

_ 

1.0 

.80 

Grade  k 
Total 
KMCC 

. 

_ 

_ 

1.0 

Grade  6 
Total 
KCC 

. 

_ 

_ 

_ 

1.0 

.79 

Grade  6 
Total 
KHCC 

- 

- 

- 

- 

- 

1.0 

Underline  Indicates  a  »  .01. 


J 
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a  test  consisted  of  only  ten  Items.   Also,  the  reliabilities 
for  the  Kidder  cloze  passaces  Individually  (Tables  15,  16, 
and  17)  were  lower  than  the  total  Kidder  cloze  passage  reli- 
abilities.  However,  In  no  Instance  did  an  Individual  test 
have  a  reliability  lower  than  .65. 

The  Kidder  cloze  passages  had  been  Rasch  calibrated  to 
determine  readability  level  (Kidder,  1977).   High  correlationb 
between  Kidder  HCC  and  Homan  MCC  passages  Indicate  a  strong 
relationship  between  readability  levels  as  determined  by 
traditional  formulas  (Dale-Chall,  IS'^Q;   Harris-Jacobson  in 
Harris  &  Slpay,  1975;  Spache,  197^^)  and  the  new  method  of 
Rasoh  calibration. 

The  significant  high  correlations  between  Homan  MCC 
and  Kidder  MCC  also  suggest  that  no  learning  took  place  for 
the  students  from  the  first  testing  of  standard  cloze  pas- 
sages to  the  second  testing  with  Honan  MCC.   If  the  students 
had  experienced  information  gain  from  the  standard  cloze 
tests,  it  would  have  been  evidenced  by  low  correlations 
between  Kidder  MCC  and  Horaan  MCC,  since  half  of  the  sample 
were  given  the  Kidder  MCC  passages  at  the  first  sitting,  and 
the  other  half  were  administered  the  Kidder  HCC  passages  at 
the  second  sitting. 

Hypothesis  VIA  stated  that  there  would  be  no  relation- 
ship between  IRI's  instructional  level  scores  as  scored  by 
the  Powell  and  Betts  criteria  (a=.01).   Hypothesis  VIB  stated 
there  would  be  no  difference  between  instructional  level  means 
as  scored  by  the  Powell  criteria  and  Betts  criteria  (a=.01). 
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Hypothesis  VIC  stated  that  when  the  Powell  and  Eetts  criteria 
did  not  place  students  at  the  same  instructional  level,  a 
greater  proportion  of  students  would  be  placed  at  a  hlf-her 
Instructional  reading  level  by  the  Powell  criteria  than  the 
Betts  criteria  (a=.01).   Hypothesis  VID  stated  that  students 
would  be  placed  at  the  sane  instructional  level  by  the  Powell 
and  Betts  IRI  criteria  at  least  75  percent  of  the  tlr.e. 

Table  19  shows  the  correlations  between  Ir.I's  scored  by 
the  Powell  criteria  and  IRI's  scored  by  the  Betts  criteria  at 
the  second,  fourth,  and  sixth  grade  levels. 

Hypothesis  VIA  was  rejected  at  all  three  grade  levels. 
There  was  a  significant  (a=.01)  relationship  between  IRI's 
scored  by  the  Powell  criteria  and  IRI's  scored  by  the  Betts 
criteria. 

Hypothesis  VIE  involved  the  differences  between  Instruc- 
tional level  mean  scores  when  an  IRI  was  scored  by  the  Powell 
criteria  and  Betts  criteria.   Table  20  depicts  the  neans  and 
standard  deviation  of  the  Powell  criteria  instructional  level 
means  and  the  Betts  criteria  instructional  level  means. 

At  all  grade  levels  the  Powell  criteria  instructional 
level  means  were  higher  than  the  Betts  criteria  instructional 
level  neans.   The  differences  between  the  neans,  when  tested 
for  significance  with  a  ^-test  for  means,  were  all  significant 
at  the  .01  and  the  .001  levels.   In  terns  of  placenent  of  stu- 
dents, this  means  an  important  difference  exists  depending  on 
whether  the  Powell  or  Betts  criteria  are  used  to  score  the  IRI. 
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Table  19 


Correlations  of  the  Informal  Reading  Inventory's 

Instructional  Level  Scores  as  Scored  by  the 

Powell  Criteria  and  Eetts  Criteria  for 

the  Second,  Fourth,  and  Sixth  Grades 


Grade  2 

Powell 

IRI 

Grade  2 
Eetts 

IRI 

Grade  4 
Powell 

IRI 

Grade  l» 

Betts 

IRI 

Grade  6 
Powell 

IRI 

Grade  6 

Betts 

IRI 

Grade  2 

Powell 

IRI 

1.0 

.80 

Grade  2 

Betts 

IRI 

_ 

1.0 

Grade  4 

Powell 

IRI 

_ 

_ 

1.0 

.80 

Grade  4 

Betts 

IRI 

. 

_ 

1.0 

Grade  6 

Powell 

IRI 

. 

_ 

_ 

_ 

1,0 

.85 

Grade  6 

Betts 

IRI 

- 

- 

- 

- 

- 

1.0 

Underline  Indicates  a  =  .001. 
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Table  20 


Means,  Standard  Deviations,  and  Standard 

Errors  of  Instructional  Level  Scores  as 

Determined  by  the  Pov^ell  Criteria  and 

Betts  Criteria  for  the  Second, 

Fourth,  and  Sixth  Grades 


JL 

32 

X 

SD 
1.656 

SE 

Grade  2 
Powell  IRI 

3.0313 

0.293 

Grade  2 

Betts  IRI 

32 

2.1875 

1.712 

0.303 

Grade  k 
Powell  IRI 

30 

1.533 

1.224 

0.224 

Grade  ii 
Betts  IRI 

30 

3.867 

1.^79 

0.270 

Grade  6 
Powell  IRI 

31 

5.'<19 

1.177 

0.211 

Grade  6 
Betts  IRI 

31 

'«.903 

1.535 

0,276 
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Hypothesis  VIB  was  rejected  at  all  levels.   A  signifi- 
cant difference  In  Instructional  level  neans  did  exist  between 
IRI  scores  obtained  by  the  Powell  criteria  and  those  obtained 
by  the  Betts  criteria. 

While  Investigating  these  differences,  additional  infor- 
mation concerning  instructional  level  means  became  apparent. 
A  comparison  of  instructional  level  means  using  the  Powell 
and  Betts  criteria  was  made  at  grade  levels  one  to  seven. 

Table  21  shows  the  instructional  level  standard  cloze 
percentages  as  determined  from  IRI's  scored  by  the  Powell 
and  Betts  criteria. 

Fewer  students  were  at  each  instructional  level  using 
the  Betts  criteria.   More  students  tended  not  to  fit  in  at 
any  one  level.   Due  to  the  nature  of  the  cloze  passages  used, 
second  grade  students  would  need  to  have  scored  at  the  first, 
second,  or  third  grade  instructional  level  on  the  IRI  to  have 
their  scores  Included  in  the  instructional  level  means. 
Fourth  graders  had  to  be  Instructional  at  the  third,  fourth, 
or  fifth  grade  level,  and  sixth  graders  had  to  be  instruc- 
tional at  the  fifth,  sixth,  or  seventh  grade  levels  to  be 
included. 

The  range  of  standard  cloze  Instructional  level  scores 
using  the  Powell  criteria  was  13  percent  to  U5   percent.   The 
13  percent  for  second  grade  was  exceptionally  low.   This  per- 
centage was  probably  distorted  because  five  of  the  thirteen 
students  received  scores  of  zero  on  the  standard  cloze  tests. 
Many  of  them  did  not  even  attempt  to  complete  any  of  the 
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Table  21 


Instructional  Level  Cloze  Score  Percentages 

as  Determined  by  the  Powell  Criteria 

and  Betts  Criteria 


Grade 

JL 

Cloze  %   Us 
Betts  Crlt 

ing 
eria 

iL 

Cloze  %   Using 
Powell  Criteria 

1 

5 

57:8 

0 

- 

2 

7 

26% 

13 

13J 

3 

11 

37% 

7 

37X 

14 

11 

39? 

9 

36J 

5 

10 

H8){ 

20 

«5J 

6 

12 

38? 

11 

38< 

7 

_1 

tl? 

_i 

lit 

Total     59  ^5 


83 

Items.   Ignoring  that  percentage,  the  range  of  instructional 
level  scores  using  the  Powell  criteria  was  36  to  'J5  percent. 
The  range  using  the  Eetts  criteria  was  36  to  57  percent. 
Using  either  IRI  scoring  criteria  base,  it  indicates  that  the 
existing  criteria  for  standard  cloze  instructional  level 
scores  may  be  too  high.   The  original  Bomuth  (1967)  criteria 
of  38  to  50  percent  comes  closest  to  matching  the  percentages 
derived  from  the  present  study.   The  other  criteria,  Bornuth 
{1968)  of  im   to  57  percent,  Rankin  and  Culhane  (1969)  from 
41  to  61  percent,  and  Alexander  (1968)  from  4?  to  60  percent, 
all  seem  too  high.   Perhaps  criteria  differentiated  by  grade 
level  are  needed. 

The  closeness  In  range  of  Powell  and  Betts  cloze 
instructional  scores  did  not  reflect  the  very  real  differ- 
ences present  in  placing  students  at  their  instructional 
reading  level  based  on  the  Powell  or  Betts  criteria. 

Hypothesis  VIC  involved  the  placement  of  students  at 
instructional  level  by  the  Powell  and  Betts  criteria.   The 
hypothesis  stated  that  when  the  Powell  and  Betts  criteria 
do  not  place  students  at  the  same  instructional  level,  a 
significantly  greater  proportion  of  students  will  be  placed 
at  a  higher  Instructional  reading  level  by  the  Powell  criteria 
than  the  Betts  criteria  (a=.01). 

A  Chi  Square  test  was  done  to  test  this  hypothesis.   It 
was  expected  that  when  the  Powell  and  Betts  criteria  placed 
students  at  different  levels  the  Powell  criteria  would  place 
students  at  a  higher  instructional  level  50  percent  of  the 
tine. 
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Hypothesis  VIC  was  accepted.  The  Chi  Square  test 
results  Indicated  that  the  number  of  tines  the  Powell  criteria 
placed  a  student  at  a  higher  Instructional  level  than  the 
Betts  criteria  was  significant.   In  fact.  In  every  case  where 
the  Powell  and  Betts  criteria  did  not  place  students  at  the 
same  Instructional  level,  the  Powell  criteria  placed  students 
at  a  higher  level. 

Hypothesis  VID  stated  that  the  Powell  and  Betts  criteria 
would  place  students  at  the  same  Instructional  level  at  least 
75  percent  of  the  time.  Using  percentages.  It  v/as  deternlned 
that  the  Powell  and  Betts  criteria  placed  students  at  the 
same  instructional  level  only  51  percent  of  the  tine.  Forty- 
nine  percent  of  the  time  the  Powell  and  Betts  criteria  placed 
students  at  different  Instructional  levels. 

Of  that  l»9  percent,  the  Powell  criteria  always  placed 
students  at  a  higher  Instructional  level.   Fifty-five  percent 
of  the  time  the  Powell  criteria  placed  the  students  one  grade 
level  above  the  Betts  criteria  placement.   Thirty-eight  per- 
cent of  the  time  the  Powell  criteria  placed  the  student  two 
grade  levels  above  the  Betts  criteria  plncement.   However,  in 
five  cases  (28  percent)  the  two  levels'  differences  involved 
a  jump  from  frustration  level  according  to  the  Betts  criteria, 
to  the  second  grade  instructional  level  according  to  the 
Powell  criteria.   In  the  remaining  7  percent  (three  cases) 
the  Powell  criteria  placed  the  student  three  grade  levels 
above  the  Betts  criteria. 
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The  highest  Instructional  level  score  attained  by  a 
student  was  used  for  analysis  In  all  parts  of  Hypothesis  VI. 
Hypothesis  VID  is  rejected.   The  Powell  and  Betts  criteria 
did  not  place  students  at  the  sane  Instructional  level  75 
percent  of  the  time. 

The  Important  and  statistically  slcnlflcant  differences 
In  placement  based  on  scoring  criteria  indicate  that  classroom 
teachers  should  choose  the  IRI  scoring  criteria  they  will  use 
carefully  based  on  a  conviction  of  accuracy  of  placement. 

Theoretical  Considerations 

One  of  the  original  intents  of  this  study  was  to  set  up 
a  criteria  for  Homan  MCC  to  be  used  by  the  classroom  teacher 
for  determining  Instructional  reading  level.   This  was  to  be 
acconpllshed  by  using  a  regression  equation  based  on  Homan 
MCC  scores  regressed  on  standard  cloze  scores  for  the  purpose 
of  setting  up  an  equation  that  would  predict  Homan  MCC  scores. 
If  the  predicted  Homan  MCC  scores  correlated  highly  with  the 
actual  Homan  MCC  scores,  criteria  for  Homan  MCC  instructional 
level  scores  could  be  set  up  based  on  how  the  same  students 
perforraed  on  standard  cloze  tests. 

It  was  assumed  that  the  correlations  between  standard 
cloze  and  MCC  would  be  high,  especially  since  the  same  stu- 
dents were  given  the  same  passages,  only  in  different  form. 

However,  the  correlations  between  standard  cloze  and 
MCC  scores  were  much  lower  than  anticipated.  The  accuracy 
and  practicality  of  using  standard  cloze  to  predict  Homan  MCC 


86 

cloze  scores  became  an  Issue.   Since  only  the  second  grade, 
second  level  correlation  scores  reached  the  desired  level  of 
practical  significance,  it  was  impractical  to  set  up  the  new 
criteria  for  Honan  MCC.   The  criteria  would  not  have  been 
accurate  for  classroom  use. 

The  fourth  grade  correlations  represented  the  highest 
overall  correlations  between  standard  cloze  and  V.CC .      Also, 
the  fourth  grade  distributions  were  all  norrial.   For  this 
reason,  the  fourth  grade  scores  were  used  to  determine  how 
accurate  or  practical  a  prediction  of  scores  could  be  made 
fron  standard  cloze  to  Homan  MCC. 

The  fourth  grade  sample  was  randomly  divided  into  halves. 
One  half  was  used  to  derive  the  regression  welrhts;  the  other, 
to  cross  validate  the  regression  weights.   This  was  done  with 
three  separate  regressions,  one  for  each  passage  level.   The 
regression  equations  are  listed  in  Table  22. 

The  predicted  Homan  MCC  scores  based  on  the  regression 
equation  were  then  correlated  with  the  actual  Homan  MCC 
scores  of  the  second  half  of  the  sample.   The  correlations 
ranged  from  .61  to  .69.   Using  the  highest  correlational  .69, 
only  47.6  percent  shared  variance  existed  between  standard 
cloze  scores  and  Homan  MCC  scores. 

The  purpose  of  the  prediction  equation  was  to  set  up  the 
criteria  for  determining  instructional  reading  level.   V.Tien 
dealing  with  the  placement  of  students  in  the  correct  Instruc- 
tional level  and  thereby  correct  reader,  having  more  than  50 
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Table  22 


Constant  and  b  Values  Used 
In  the  Prediction  Equation 


Grade  Level  b  Constant 

3  O.U837  16.1227 

4  0.6950  11.4i)65 

5  0.6091  13.9831 
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percent  of  the  variance  of  MCC  not  explained  by  standard 
cloze  leaves  too  much  room  for  placenent  error. 

These  results  reinforce  that  standard  cloze  scores 
should  not  be  used  to  develop  a  criteria  for  uslnn  Honan  "CC 
scores  In  the  classroom  to  determine  Instructional  reading 
level. 


CHAPTER  V 
SUMMARY  AND  CONCLUSIONS 


Standard  cloze  and  the  IRI  are  both  used  to  deternlne 
instructional  reading  level.   This  study  was  designed  to 
explore  the  relationship  of  a  new  form  of  cloze  test,  '.'.CC,   to 
standard  cloze  and  the  IRI.  The  intent  has  teen  to  obtain 
new  information  that  would  assist  the  classroom  teacher  in 
determining  the  instructional  reading  level  of  all  students 
as  easily  and  accurately  as  possible. 

Six  main  objectives  are  included  in  the  investiratlon. 

1.  Comparison  of  standard  cloze  and  V.CC   tests  for  the 
same  passages,  with  the  same  students. 

2.  Examination  of  the  strength  of  the  relationship 
between  standard  cloze  and  MCC  passages  for  the  purpose  of 
determining  if  standard  cloze  scores  can  be  used  to  predict 
MCC  scores. 

3.  Investigation  of  the  relationship  a.r.ong  standard 
cloze  scores,  MCC  scores,  and  the  IRI. 

H.      Determining  the  reliabilities  of  the  standard  cloze, 
MCC,  and  Kidder  MCC  passages. 

5.   Examination  of  the  relationship  between  two  fonss 
of  MCC  tests,  Homan  MCC  and  Kidder  MCC. 
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6.   Investigation  of  the  relationship  between  IRI's 
Instructional  level  scores  as  scored  by  the  Powell  criteria 
and  Betts  criteria. 

Three  schools,  representlnc  high,  mediuni,  and  low  socle- 
economic  groups  were  involved  in  the  study.   All  second, 
fourth,  and  sixth  graders  at  all  three  schools  participated 
in  the  study.   A  total  of  S'tS  students  were  included  in  the 
final  analysis  of  data. 

Each  student  was  administered  three  standard  cloze 
tests.   One  test  was  at  the  student's  grade  level,  one  v;as  a 
grade  level  above  the  student's  grade  level,  and  the  third 
was  a  grade  level  below  the  student's  grade  level. 

Multiple  choice  cloze  tests  were  r.ade  from  the  sar.e  pas- 
sages used  for  the  standard  cloze  tests.   Cn  a  second  testing 
occasion,  each  student  was  administered  three  MCC  tests 
covering  the  same  grade  levels  as  the  standard  cloze  tests. 
Additional  Kidder  MCC  tests  were  administered.   These 
tests  were  also  at  three  different  grade  levels.   One-half  of 
the  students  were  administered  the  Kidder  MCC  test  with  the 
standard  cloze  testing,  and  the  other  half  were  administered 
the  Kidder  MCC  test  with  the  Homan  MCC  test.   Individual  I?I's 
were  administered  to  at  least  thirty  students  at  each  grade 
level. 

Six  hypotheses  were  tested  in  the  study.   Some  hypotheses 
had  several  sub-hypotheses  connected  to  them. 

1.   Hypothesis  lA  stated  that  there  would  be  no  differ- 
ences between  the  m.ean  scores  for  standard  cloze  and  "CC 
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passages  for  the  same  group  of  students.  Mean  scores,  how- 
ever, were  not  equal,  and  the  differences  were  shown  to  be 
statistically  significant.   The  form  of  cloze  test  used  did 
affect  the  score  of  the  students.   Cn  the  average,  students 
scored  lower  on  standard  cloze  tests  than  on  HCC  tests. 

Hypothesis  IB  stated  that  there  would  be  no  differences 
among  the  mean  scores  on  the  three  levels  of  difficulty 
tested  for  each  group.   For  the  second  grade  all  passage 
scores  were  significantly  different  from  each  other.   At  the 
fourth  grade  level  all  standard  cloze  mean  scores  were  signif- 
icantly different  from  each  other.   However,  for  MCC  scores 
the  fifth  grade  passage  mean  scores  were  significantly  differ- 
ent from  both  the  third  and  fourth  grade  level  mean  scores. 
The  third  and  fourth  level  mean  scores  were  not  significantly 
different  from  each  other.   At  the  sixth  grade  level  all 
standard  cloze  mean  scores  were  significantly  different  from 
each  other.   The  sixth  grade  MCC  scores  indicated  the  seventh 
level  passage  scores  were  significantly  different  from  the 
fifth  and  sixth  level  passage  scores.   As  would  be  expected, 
student  scores  decreased  as  the  readability  levels  of  the 
passages  increased.   The  MCC  passages  did  not  also  show  this 
difference  in  scores,  possibly  because  of  the  very  high 
scores  many  students  received  on  all  three  levels  of  MCC 
passages. 

Hypothesis  IC  stated  there  would  be  no  interaction 
between  the  form  used  and  the  level  of  passage  difficulty.   A 
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significant  Interaction  was  evidenced  by  the  data,  and  did. 
In  fact,  exist. 

2.  It  was  hypothesized  that  a  correlation  of  .70  or 
more  exists  between  standard  cloze  and  HCC.   Surprisingly, 
this  was  not  the  case.   The  correlations  between  standard 
cloze  and  MCC  on  the  same  passages  were  nuch  lower  than 
anticipated.   Thus,  It  seems  reasonable  to  question  whether 
the  two  test  forras  actually  measure  the  same  type  of  reading 
comprehension . 

3.  It  was  hypothesized  in  IIIA  that  there  would  be  no 
relationship  between  standard  cloze  scores  and  IRI  scores. 
Hypothesis  IIIB  stated  there  would  be  no  relationship  between 
MCC  and  IRI  scores.   These  correlations  were  very  low  in  some 
instances  and  only  significant  on  occasion.   The  sixth  grade 
correlations  were  most  often  significant.   This  raises  ques- 
tions as  to  whether  the  IRI  and  standard  cloze  are  both  meas- 
uring the  same  thing  in  attempting  to  determine  instructional 
level. 

Hypothesis  IIIC  stated  the  correlations  between  f'CC 
scores  and  IRI  instructional  level  scores  will  be  the  same  as 
the  correlations  between  standard  cloze  scores  and  V:i   instruc- 
tional level  scores.   The  results  of  analysis  were  mixed. 

For  the  second  grade  sar.ple  significant  differences 
were  apparent  between  correlations  of  IRI  scores  and  MCC 
scores  and  standard  cloze  and  IRI  scores.   At  two  passage 
levels  the  standard  cloze  and  IHI  score  correlations  were 
higher. 
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The  fourth  grade  passage  scores  showed  no  significant 
differences.   However,  the  sixth  grade  passage  scores  evi- 
denced mixed  results.   On  the  fifth  grade  level  passage  the 
standard  cloze  correlation  with  IRI  scores  was  significantly 
higher  than  the  MCC  and  IRI  score  correlation.   The  sixth 
and  seventh  grade  level  passage  scores  Indicated  no  signifi- 
cant differences  between  correlations  of  standard  cloze  and 
IRI  scores  and  MCC  and  IRI  scores.   Since  the  degree  of 
correlation  between  standard  cloze  and  MCC  to  the  IRI  was  not 
significant  in  many  Instances,  it  would  be  inappropriate  to 
try  to  draw  an  overall  conclusion  about  which  test  form  is 
most  closely  correlated  with  the  IRI. 

U.      It  was  hypothesized  that  MCC  passage  reliabilities 
would  be  the  same  as  standard  cloze  passage  reliabilities  at 
the  same  passage  level.   In  fact,  r-XC  and  standard  cloze  pas- 
sage reliabilities  were  not  the  sane.   MCC  reliabilities  were 
higher  for  all  grade  levels  on  all  passages. 

5.  Hypothesis  V  stated  that  there  would  be  no  relation- 
ship between  total  Homan  riCC  scores  and  total  Kidder  MCC 
scores.   The  correlations  were  significant  at  all  levels. 
This  indicated  also  that  traditional  readability  formulas  and 
Rasch  calibrated  readability  measure  the  same  thing. 

6.  Hypothesis  VI  had  four  parts.   Hypothesis  VI  stated 
there  would  be  no  relationship  between  IRI's  scored  by  the 
Powell  and  Betts  criteria.   A  significant  relationship  did 
exist  between  the  results  of  the  two  scoring  criteria. 
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However,  Hypotheses  VIB,  VIC,  and  VID  dealt  with  differ- 
ences between  the  two  scoring  criteria  and  found  them  to  be 
significant  and  of  vital  importance  concerning  placement. 
There  were  significant  differences  at  all  three  grade  levels 
between  the  mean  scores  obtained  by  the  two  different  scoring 
criteria. 

The  two  sets  of  criteria  place  the  student  at  the  same 
level  only  51  percent  of  the  time.   Furthermore,  the  analysis 
indicated  that  when  the  two  sets  of  criteria  did  not  place 
the  students  at  the  same  level,  the  Powell  criteria  placed 
the  students  at  a  higher  level  100  percent  of  the  time. 

This  empirical  examination  of  the  relationship  among 
standard  cloze,  and  IRI,  and  MCC,  yielded  several  useful 
findings.  First,  there  Is  some  evidence  that  MCC  does  not 
measure  the  same  type  of  reading  comprehension  as  measured 
by  standard  cloze  or  the  IRI.   The  Information  on  this  Issue 
is  inconclusive  and  further  study  Is  indicated  before  more 
specific  conclusions  can  be  reached.   Second,  the  relationship 
between  standard  cloze  and  the  IRI  also  appears  tenuous. 
Third,  the  scoring  criteria  used  for  the  IHI  can  make  very 
significant  differences  in  terms  of  accurate  student  placement. 
While  these  findings  are  not  definitive  for  the  classroom 
teacher,  they  add  to  the  much  needed  specific  information 
concerning  testing  and  placement  for  Instructional  reading 
level. 


APPENDIX  A 
DIRECTIONS  FOR  CLOZE  TESTINGS 


DIRECTIONS  FOR  STA.\'DARD  CLOZE  TESTIIJG 

Boys  and  girls,  this  exercise  Is  trying  to  find  a  new 
way  to  be  able  to  tell  if  you  understand  what  you  read. 
Every  fifth  word  has  been  left  out  of  the  story.   You  nust 
think  of  a  word  that  makes  sense  In  the  story  and  Vfrlte  It 
on  the  line.   All  lines  are  the  same  length.   A  big  word 
might  be  missing  or  a  little  word  like  "a,"  and  "the."  Only 
one  word  can  go  in  each  space. 
Second  Grade  Example 

The  dog  ran  to  door.   He  wanted  to  

In- 

Fourth  and  Sixth  Grade  Exariple 

The  swing  went  back  forth. 

If  you  leave  some  blanks  during  the  first  reading  (and 
you  probably  will)  go  back  and  try  them  again. 

If  you  can't  spell  a  word,  hold  up  your  hand  and  I  will 
help  you.   I  can't  tell  you  any  words,  but  I  can  help  you 
spell  words. 

When  you  finish  one  story  start  working  on  the  next  one. 
Continue  working  until  all  stories  are  finished.   Raise  your 
band  when  you're  finished  and  your  test  will  be  collected. 

Are  there  any  questions? 

You  may  begin. 
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DIRECTION'S  FOR  ALL 
MULTIPLE  CHOICE  CLOZE  TEGTI.'.'GS 


Here  are  some  stories  for  you  to  read.   Tr.ls  tlr^e 
there  are  no  blank  spaces.   But,  for  every  flftr.  xord 
you'll  see  three  words  In  one  space.   Circle  the  one  -rford 
that  makes  the  most  sense  In  the  story.   There  Is  only 
one  correct  answer. 

Are  there  any  questions? 

You  may  begin. 


APPENDIX  B 
STANDARD  CLOZE  PASSAGES 


STANDARD  CLOZE 
Test  1 

Look  at  the  cat.   The  cat  Is  very  fat.   The  children 

liked  the  cat.   The  fat  cat  away.   The 

children  looked  the  fat  cat.   The  cat 

looked  for  the  .   The  fat  cat  was  .   Did 

you  see  a  cat? 

The  fat  cat  back.   He  looked  for  

children.   He  looked  this  .   He  looked  that  way. 

children  looked  too.   They  for  the  fat 

cat.   fat  cat  said,  "Kelp!"  children 

ran.   They  ran  the  fat  cat.  He  not  lost 

now.   The  cat  was  home.   He  happy. 
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Test  2 

Once  upon  a  tine  a  king,  a  queen,  and  their  son  Todd 
lived  on  the  top  of  a  huge  mountain.   They  lived  in  a 
castle. 

There  was  socethlng  wanted  very  much.   He 

a  puppy.   He  knew  would  be  fun  to 

with  a  dog. 


One  Todd  asked  the  king  queen 

for  a  dog.  king  thought  about  it  a 

long  time,  but  wouldn't  give  Todd  a  

answer.   This  made  Todd  . 

Several  days  passed.   Todd  thought  about  a 

puppy.   next  day  a  large  drove  up  to 


the  entrance.  The  driver  walked  to 

the  door. 

"I  something  for  Todd,"  he  .   1 

man  took  a  out  of  the  oar.  .'  There 

were  three  happy  puppies  in  the  box.  

Todd  was  really  happy. 
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Test  3 


Arnold  was  not  an  ordinary  cat.   His  rT;aglc  powers  made 
very  special.   It  was  to  spot  Arnold 


in  crowd  of  cats.   Ke  the  one  who 

winked  eye  and  stuck  his  In  his  mouth. 

If  winked  with  his  left  and  had  his 

tall his  mouth  It  ir.eant  unusual  was 

going  to  ,  however,  when  Arnold  winked  

his  right  eye  and  his  tall  In  his  it 

meant  something  else.  meant  something  strange, 

possibly  frightening,  was  about  to  . 

One  day  as  I  walking  down  the  street 

saw  Arnold  step  out  between  two  garbage 

cans.   decided  to  follow  Arnold  see  if 

he  was on  using  his  powers. 
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Test  ^t 

It  was  a  cold,  damp,  and  rainy  day.   Both  Kike  and 

Fever  traveling  as  fast  as  to  avoid 

getting  drenched  the  rain.   Fever,  Jet  


and  fearless,  had  been  horse  for  as  Ions  

they  could  remember.   Suddenly,  reared  back  coming 

to  complete  stop.   Fever  and  stood 

shivering  in  front  a  tremendous  fallen  tree. 

•    hesitated,  he  knew  Mike  him  to 

Jump  over  tree  and  continue  on  journey, 

but  something  was  him  from  galloping  over  

The  horse  was  afraid,  even  he  didn't  know  

was  scaring  him. 

When  was  a  young  colt  attempted 

to  Jump  over  tree  that  had  fallen.  

was  not  successful,  and  fractured  his  leg. 
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Test  5 


The  queen  was  disturbed.   Her  pet  ov;l,  Vflse, 


not  feeling  well  at  .   Kls  feathers  dropped  and 

"whoooo"  was  exceptionally  weak.   had 

been  sick  before,  he  was  never  this  . 


He  wouldn't  even  spread  wings  for  a  special 

treat,  even  his  favorite  _. 

The  queen  decided  to  the  doctor.   She 

wouldn't  by  and  watch  Wise's  get 

droopier  and  droopier. 

the  time  the  doctor  Wise  was  too 

weak  stand  on  his  perch.   a  careful 

examination  the  said  that  V/ise  had  very 

unusual  sickness.  The  vfay  for  hia  to  

better  would  be  to  leaves  fron  the  Einga-Banga 

.  There  was  only  one tree  in  the  whole 

world. 
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Test  6 

David  and  Donnle  had  been  best  friends  for  as  far  back 
as  either  of  them  could  remember.   They  shared  a  huge 

story  tree  house  In giant  tree  that 

divided  backyards  of  the  two • 


The  tree  house  was  around  town  as  David 

Donnle's  Detective  Den.   Ever  David 


and  Donnle  solved  haunted  house  mystery  they 

considered  two  of  the  .  and  most 

successful  detectives  the  city. 

When  the  for  the  sixth  grade  was 

discovered  missing,  David  Donnle  were  the  two 

people  to  turn  to  help.   When  Lisa 

v^ent count  the  money  on  afternoon  the 

box  was  •  The  missing  sixth  grade was 

a  problem  In  ,  but  eighty-five  dollars  was 

reported  stolen  from  the  __• 
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Test  7 

The  wizard  drew  his  black  cape  close  to  his  body  to 

keep  out  the  cold.   The  forest  seemed  to  In 

around  him  as  temperature  dropped.   He  was 

the  center  of  the  Forest.   The  queen  of 

green  elves  was  meeting  there  at 

exactly  midnight. 

was  not  well  In  land.   The  wizard 

had danger  for  weeks  nov;,  until  the 

queen  of elves  had  called  this  .  he  was 

uncertain  of  extent  of  the  trouble.   

the  queen's  note  had  was  that  the  evil  

of  the  West  had  gathering  troops.   The  wizard 

this  meant  an  attack.  wizard  sighed. 

He  was  now,  he  doubted  the  of  his  power. 


APPENDIX  C 
HOMAN  MULTIPLE  CHOICE  CLOZE  PASSAGES 


HOMAN  MULTIPLE  CHOICE  CLOZE 
Test  1 
Look  at  the  cat.   The  cat  Is  very  fat.   The  children 


liked   the 


[Beaut  if  ufl  fat      "1 

fat  cat.      The   fat   cat      bring 

looked      J  Iran    J 

fTor    "I  raowiTj 

was     the  fat  cat.   The  the   cat 
[eitherj  IX^t  _[ 


away .   The 


children  looked   was     the  fat  cat.   The  the   cat  looked 


for  the  I  now 


[now  ^"^   I  .   The  fat  cat  was  Jcat  |  .   Did  you  see  a 
childr 


The  fat  oat   came   back.  He  looked  for  near  children. 


Ke  looked  this 


looked  too.   They 


said,  "Help 


cat .   He 


[lookecTl  PatT 

way     .   He  looked  that  way.    The  ch 
nice  J  b^y 

frace  "|  The   "| 

hooked   for  the  fat  cat.    Several 
[fat   J  Irat    J 

•"   Not   children  ran.   They  ran  Ithanl  the 

IrheJ  b°  J 

fTor    -|  ffat  "I 

Iwas  not    lost   now.      The      children 

|touchJ  l^ell         J 


cat   was   home. 


happy. 
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Test  2 
Once  upon  a  tL-ne  a  king,  a  queen,  and  their  son  Todd 

[Sad 
dog 
roya 

castle. 

land    1 

There  was  something  blanket   wanted  very  much.   He 
ijodd   J 

[wantecTl  ploclT]  p    "I 

now     a  puppy.   He  knew   It     would  be  fun  to   play 
call  J  |nextj  LdlnnerJ 


J 


with  a  dog. 


One  really  Todd  asked  the  king  and   queen  for  a  dog. 


If  or  J 


[eye   ~| 
really  Tc 
day  J 

rqueerT]  1^^^ 

for    a  long  time,  but   a 
Lin   J  Lhe  J 

Idlrect 
llight J 


king  thought  about  It 


[unhappyl 
wouldn't  give  Todd  a  Idlrect I  answer.   This  made  Todd  Inlddle 

[light  J  Lnade   J 

[?odd~] 
often  thought  about  a  puppy. 

La^ge  next  day  a  large  present   drove  up  to  the  were 
[put  J  bar    J  least  lej 

Tup         "I 

entrance.      The  driver  walked      It  to   the  door. 

jseveralj 
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[have  1  fsald      "I 

car  sor.ethlng   for  Todd,"   he      up  I 

smllej  Lswallo\J 


[crate    "1  H^urtle    T 

passed    I    out    of   the   car.       ISurprisel    ;      There   were 
thoughtj  Lyp        J 


three   happy 


fllttl^  poungl 

Ithe         I    puppies    in   the   box.       iThe  Toe 

IwholeJ  \iioyi    J 


really  happy. 


no 

Test   3 

Arnold  was  not  an  ordinary  =at-   His  magic  powers  nade 

I  attention!  Peasy"! 

him        very  special.   It  was  |-»-as   j  to  spot  Arnold  In 
from    J  JtlackJ 

finy        "I  piose        ~] 

going  crowd  of  cats-      Ke   I  scr.etr.lng      tne 

LcarcfulJ  bas  J 

[dinner"!  [tail  "1 

his  !    eye  and   stuck  his   I  to  ! 

unusual]  [sonettinz] 

n-iag    "I  fsrar-dfathein 

Arnold     winked   with  his   left    I  Ir.  and  had  his   tall 

[and      J  y^e  J 

riacket        I 

jal  was  going  to 


,ie  one  who  winked 


in  his  mouth.   11 


lis  right  eye 


It  meant  something  else. 


rir    "1  packet;      T 

in      !    his  mouth   it  meant    !was  |    unusua 

[tailj  Isomethir.r) 

[occur"!  piear"! 

Arnold]    ,    however,   when  Arnold  winked   !with    |    h3 
lick    J  [meantj 

jlept      "I  Cpastiirej 

and  I  however  I  his   tail    in  his    jmear.t      | 
[notice  J  [mouth    J 

[It  ~!  [even"] 

Was  I  meant   something   strange,   possibly      his  frightening, 

PresentJ  [rounclj 

fsew       ~| 

jtail       I    . 
[happenj 

pas    "I  n    1 

Ismlle      I    walking  down  the   street      with 
[unusualj  [sugarj 

.R"     1 

JTurtleJ 


was  about  to 


One  day  as   I 


[powers! 
from      I   bet-feen  two  garbage   cans 
this    J 


Ill 


decided  to  follow  Arnold 


on  using  his  powers. 


[powers]  [plannlnEl 

to    I  see  If  he  was  I  tail    I 
whllej  Ijell    J 


i 


had  been 
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Test  1 
It  was  a  cold,  damp,  and  rainy  day.   Both  Mike  and  Fever 

[possible! 
ax      I  to  avoid  getting 
even    J 

fby  1  fclea-n 

;d   I  something      the   rain.      Fever,   Jet   Ihl-.  and   fearless 

Ibut  J  IplackJ 

[Pllke'sl  nf    1 

and        I    horse   for  as   long   las      1   they   could   remember, 
dart    J  IbackJ 

[t'ever    "I  Thofl 

by     ,  reared   back  conln?:  to   IMasI    cor^plete   stop. 

hoi  Ida  J  b    J 

[the  "1  ptree"! 

Mike  stood   shivering   In   front    Iput        a 

outdoorsj  lof    J 


Fever  and 


tremendous   fallen  tree. 


Jump  over 


rto      T  fthe      "I 

iRat  hesitated,    he  knew  Mike    I  wanted  I   h^n  to 

[FeverJ  iToti      J 

fthe    "I  fsplnachl 

jFever     tree  and   continue  on     their      I   Journey,   but   something 
[to      J  bven      J 

fcover  "1  l^*'  I  mv, 

was   land  I    him  from  galloping  over    jeven  I    .      The 

[preventing  IsunshlneJ 

r&ut  "1  peveiTl 

,      so  even  he  didn't   know   I  what    I   was 

[werej  ItlredJ 


horse  was  afraid, 


scaring  him. 
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fTiad   "1  fTieT 

When  I  Fever   was  a  young  colt  and  I  attempted  to  Jump 
|valle:J  [we  J 

'alien.  Ishlverlng  was  not 
[Youth    J 

pe      -] 

,  and  I  a       I 

[accldentj 


successful,  and  a       I  fractured  his  leg. 


Hi* 
Test  5 


[baking! 
owl  I 
was   J 

fall     1 

[disturbed!  . 
[but     J 

n^lll  pocooi^ 

Ithel  "whoooo"  was  exceptionally  weak.   By 
|cagj  blse  J 


The  queen  was  disturbed.   Her  pet  owl.  Wise, 

fall     1 
not  feeling  well  at  [disturbed   .   Kis  feathers  dropped  and 


had  been  sick 
;/lse  J 

tbut~l  TelboCn 

down  he  was  never  this   sick    .   He  wouldn't  even 
WlseJ  LthatJ 

fills  1  fgoatl 

spread  Ineverl  wln^s  for  a  special   too   treat,  even  his 
[flag J  [owl  J 


favorite 


fBut    "1 

[kind     I 
[wouldn'tj 


[Insult"] 
wings   the  doctor.   She  wouldn't 
call  J 

la^"  I  by  and  watch  Wise's  I  feathers  get  droopier  and  droopier. 
[sit  J  U?ad    J 

fBy  -I  Tplled  -| 

lof   I  the  time  the  doctor  arrived  Wise  was  too  weak 

[sickj  [and        J 

ffatherl  j^fteiH 

Iwatch    I   stand   on   his  perch.        Sit  a   careful   examination 

[to         J  ISaine  J 

raoctorl  l^uclTl 

the    Ito  said   that   Wise  had      a  very  unusual    sickness. 

jsllk    J  [his  J 

(Treat']  Tweed         "I 

way   for  him  to     get  better  would  be   to    Ichew 

[his    J  [feathersj 


115 


[accident! 
tree      .   There  vfas  only  one 
the    J 

tree  in  the  whole  world. 
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Test  6 

David  and  Donnle  had  been  best  friends  for  as  far  back 
as  either  of  then  could  remenber.   They  shared  a  huje 

[Iwo    1  fbut  "I 

divided   story  tree  house  in  giant   tree  that  divided 
barely  J  ]jhe    J 

[cod   1 
that 
housesj 


jbarely_) 

backyards  of  the  two 


[deal"! 
grade!  around  town  as  David 
known) 


[either 
r 

Donnle  solved 


David  and 


either!  prom     "1 

and    I  Donnie's  Detective  Den.   Ever  I  since 

two   _]  |_discoverecy 

fin     -I  fheld     1 

Inissing   haunted  house  mystery  they  detective 
[the    J  b^re     J 

|_lnstantj[ 


considered  two  of  the  lof       and  most  successful  detectives 


Isolvedl  the  city. 
of 


I  money    H  patmeail 

considered   for  the  sixth  grade  party 
petal     J  |most   J 

[put  "I 
help  Donnle  were  the  two 
and  J 


floglcal]  Ror  ~\ 

Imoney   I  people  to  turn  to  I  Lisa! 
jrainy  J  |_samej 

rto      -1 

ImisslngI    CO 
Iso  J 


help.      When  Lisa  went 
unt    the  noney  on  lever      I    afternoon   the  box  was 
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riquashl  pank"! 

tree  .      The  missing   sixth  grade    jr.oney     was   a   problem  in 

[empty  J  L?hen  J 

[itself] 
and  , 

train  J 


(empty  _J 

phile] 

but   elehty-five  dollars  was   I  also        reported   stolen 

LgiantJ 


Tofflce 
from  the   I  shared 

[afternoon 
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Test  7 

The  wizard  drev/  his  black  cape   close  to   his  body   to 

That    "] 
keep  out   the  cold.      The   forest   seemed   to    lelves      in   around 

[closej 

fTiatn  pt         "I 

him  as     the     temperature  dropped.      He  was      forest      the   cent 
[butj  [down    J 

[tark  "I  rthe    ~[ 

of  Forest.      The  queen  of    lelves      green  elve 

cranberryj  [each  J 

rthe  ~j 

was  meeting    jhim  I   there  at   exactly  midnight. 

(downstalrsj 

fFroml  jgallorn 

Iwas    I  was   not   well    in     their        land.      The  wizard  had 
[All  J  Itl^^       J 

rbut    "1 
close  I    until   the   queen  of 

le  was   uncertain  of 

the   queen's   note   had 
[All    J 

[midnight  ~\ 

[indicated  I    was   that   the   evil 

[receive    J 

f  wizard 
suspected      this   meant   an  attack. 


jT)ut    "1 
,    |close|    unt 
j_if      J 

fbeenl  [meeting] 

on      I    elves   had   called   this      the  [    he 

[the  J  [mice      _[ 

[but!  put    -| 

of    I    extent   of  the   trouble.       [V/eeks 
thej  IaII    J 

[seesaw!  pmackl 

was         I    of   the   V/est    had    [his       | 
princej  [been  J 

■] 

[f  his  "I  parm  ~[ 

[The      [   wizard   sighed.      He  was    [the  now, 

[glackj  [older] 


[stung 

he  doubted  the 


[strength! 

[yard  |  of  his   power. 

§f  J 
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KIDDER  MULTIPLE  CHOICE  CLOZE 
Test  1 

People.   People.   Kany,  many  people. 


"Good 


[Sfternoonj 
People  I 
The     J 

[Elephant]  ptreetsj 

Many      are  In  the  city.   I  Ken      i 
Houses  J  Ijn    J 

[People? 
in 
Sled  J 

nn    -] 

I  can     I 
Labove] 

■] 

1  night"? 
now   I  . " 
eye  J 


in  the  houses 

In  the  city.   I  In  "   I  are  in  the  city. 
[sled  J 

In  the  city,  lights  go  on.   Boys  and  girls  are 


Durn 
the  houses.   The  lights  I  the  I  out.   "Good  night." 


Dick  said,  "Look  at  Puff.   Puff  wants  a  ride. 


can  not  ride  in 


[hany  "I  peatH 

Sally  said,  "No,  no.  Puff.'  You 

Hen  J  IjheJ 

the  car.   Go  away.  Puff.    Know  want  Tin  to  ride   true   ." 

LputJ                    LSoodJ  \}n    J 
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Debbie  said,  "Come  here,  David.   I  v;lll  help  you 


[bark  I 
clean) 


your  shoes." 


rtavltTl  pioJ] 

"Let  me  Iflew   It,"  said  David.   You  It   clean  your 
|do   J  b^ll 

[you  "I  plean  "| 

here   do  not  have  to  I  whisper  I  ray  shoes.   I  do 
store]  [l     J 

want  help." 
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Test  2 
White  Cloud  lay  on  his  blanket  and  looked  at  the  dark 

[maybe! 
how 


to  sleep.  He  could 


po     1 

I  children 
[alrplanej 

[Fiear  ~[  fas   "1 

Billy's   the  nothers  and  fathers   either! 
come  _J  U?ear  J 

[are! 
of   night 
thej 


they  talked.   At  last   of  I  night  was  quiet. 


Dick  said,  "Look  at  this  little  red  boot.   Is  it  Billy's': 


[Ihat   1  p 

next     isn't  Billy's  boot,"  said  Ip 

mothersj  L? 

"His  boots  are  black." 


[helghborhoocri 
ship       J 


guess  someone  in  our  Ion         I  lost  it," 


said  Dick. 


[Story!  ra"'J    1 

I'll    I   take   the   boot    to     my  hou 

Isn'tJ  Lthinkl 

I  was  "I  pilso    "I 

cornel  along  and  ask  about    lit  I    ." 

I      J  LjookedJ 


se.      Maybe   someone 
[also    "] 
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Test  3 
The  wind  was  growing  stronger,  and  It  was  getting 


Eleven-year 


30k.   He  had 


hJirder  and  harder  to  walk.   In  his  hand,  the   boy   tightly 

Lsta^J 

[causecTI  fout     "I 

that    caused  him  to  stay  dangerous   so  late. 
but   J  Ls°      J 

[bid  "I  r°^^~\ 

so   I  Abe  could  not  lose  I  If    boc 
flnej  IthlsJ 

fnean  "I  fpeek   T 

liTiore   I  than  three  miles  to   fiercely 
IfaorrowJ  [borrow  J 

[so     "I  Phe  1 

blowing  I  so  fiercely  now  that  Istore   alnos 
sand   J  U^   J 


walked  lc;ore    than  three  miles  to   fiercely   it.   The  wind 


3st  snatched 


[miles! 

the  book  jfron  I  his  hand, 

[underj 
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Test  I* 
lou  sit  In  your  seat  at  the  circus,  waiting  for  the 

[thousands! 
sit        of  other  eager, 
afternoon) 

[of   1  fplay"! 

branch   .   Perhaps  you  are  sitting  crazy  up,  near 
pecplej  U^EhJ 

r,f  -j  FTilgh"! 

the  roof  are   the  huge  tent  ~  the  Up   1  Top  Itself.   Or 
j_f  romj  IplS  J 

[pink"! 
the    to  the  sawdust  ring. 


off  a 


[to   "I  Tstood    ~| 

Shady  I  the  band  begins  to  play 
Now   I  [thousandsj 

[vlllagri 
lion    I  roars. 
down   J 


Somewhere  far 
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Test  5 
Freddie  Applegate  loved  the  sea  beside  his  town.   He 


[tine! 
and  I  his  rowboat 
frorj 


aiaong  the 


crayfish. 


[llketfl 
burn  I  to 
the  J 

rSaushtefl  pearchl 

lanor.g    I  by  the  shore  and  I  he    I 
[rocks   J  y-orgetj 


for  clams  and 


[Eorseshoel  rabouri 

Freddie   I  also  liked  to  know  he     the  history  of 
Liked    J  [next  J 


bis 


[planT  po      "1 

to      I    ,   because  everywhere  he  looked    I  there  I 
towrj  IjocksJ 

piistoryT  pEhe    "I 

show  I  ar:ons      I   it   had  been  there     a 

[that      J  [llkedj 


were  things 


long  long  time. 
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Test  6 
Once  your  dog  Is  able  to  wear  a  collar,  you  must 


Introduce  him  to  the  leash.   First  let  him  smell 

n.t   "I  pthef] 

touch  it,  and  lick  I  able   so  that  he  can   crush   that  a  leash 


[about! 
It 
fouchj 

[it   "I  ptherj 

able   so  that  he  can   crush   tha 
below)  [see  J 

[and    1  fTild    1 

harmless  and  won't  bite  or  Iscratch  hlr 
finger  J  [house  J 

faroundl  fcan  "j 

Ihlm     the  house  with  the  jleashl  dragging  from  his  collar. 

[jear  J  LpeaceJ 

r&hen  "1  rsuch"!  rtake"! 

Isecond  he  loses  all  fear  of    a  leash,  you  can  wait  up 
[Loses  J  [can  J  lit  J 


Im.   Let  him  run 


dragging!  begin  guiding  him. 


[among 
drag 
and 
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Test  7 

Grendel  came  one  midnight  to  the  hall.  Tall  and  broad 


he  I  those  with  a  skin  of  I  Heorotl  green  which  no  svMord 
L?lr  J  i^old  J 


gh  the 


[was  "]  rhornyH 

those  with  a  skin  of  ( Heorot 
^ir  J  i^old  J 

[might   "f  HresseFl 

midnight  pierce.   He  strode  towards  lopen     throu 
click  J  [Heorot J 

t thrust]  r^°'] 

horny   open  the  door  of  he   hall  and  found 
frledj  b^ej 

foak   "1 
huge    .   In  his  huge 


clawed 


[oak   "1 
huge    .   In 
aslee£j 

[Fiands   "I  rsorne"! 

snatched  he  snatched  up  thirty  Ibroadj 
ponies  J  Lof   J 

[uniform] 
the    I  in  the  fen 
home   J 


those  unhappy 


[bore  ~j 
tall  I  them  off  to  his 
standj 


APPENDIX  E 
INFORMAL  READING  INVENTOR f 


129 


ORAL  READING  SELECTION  1 
(79  Words;  First  Grade  Level) 


Fun  With  Our  Friends 
(pp.  121-122) 


Preparation 

This  Is  a  story  about  a  little  girl  on  a  farm.   As  you 
read  aloud  find  ouc  why  her  Grandparents  became  worried. 
Selection 

"Sally!   Sallyl"  called  Grandmother.   "Come  here,  Sally. 
Jane  said,  "Sally  went  for  a  walk  with  Tim.   I  guess  she  went 
to  see  the  chickens.   She  wanted  to  see  them  eat."  Dick  ran 
to  the  chicken  house  to  get  Sally.   He  saw  big  hens  in  there, 
but  he  did  not  see  Sally.   "Grandmother!"  he  called.   "Sally 
is  not  here.   She  is  not  in  the  chicken  house."   "Oh  dear!" 
said  Grandmother.   "Uhere  did  Sally  go?   We  will  have  to  find 
her." 
Comprehension  Questions 

1.   Why  were  Sally's  Grandparents  v;orrled  about  her? 

(Because  Sally  was  not  where  they  thought  she 
would  be  /or/  Sally  was  not  in  the  chicken 
house) 

2.   Who  told  Grandmother  where  Sally  went? 

(Jane) 

3.   What  word  in  the  story  means  "to  decide  without 

being  sure? 

(to  guess) 
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Where  did  Dick  run  to  get  Sally? 

(the  chicken  house) 

Read  the  sentences  which  show  worry  about  Sally. 

("Oh  dear.'"  said  Grandfather.   "Where  did  Sally 
go?") 
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ORAL  READING  SELECTION  2 
(110  Words;  Second  Grade  Level) 


Friends  Old  and  I.'ew 
(pp.  224-225) 


Preparation 

This  Is  a  story  about  two  cats.   As  you  read  aloud 
find  out  which  one  was  scared. 
Selection 

One  day  old  Merry  Cat  took  Tiny  Cat  far  Into  a  cornfield 
to  catch  a  mouse.  The  corn  was  all  picked,  so  there  were  no 
crows  around.   But  a  large  scarecrow  was  still  In  the  field. 
It  was  dressed  In  a  man's  clothes,  and  around  Its  neck  was  a 
big  red  handkerchief.   Tiny  Cat  said,  "That  old  scarecrow 
scares  me.   It  does!   It  does!"  "I  think  it's  funny,"  said 
Merry  Cat.   "Farmer  Gray  made  it  with  two  sticks.   You  saw 
him  do  it  yourself."  Tiny  Cat  said,  "Yes,  I  know  I  did.  The 
scarecrow  didn't  scare  me  then,  but  it  does  scare  me  now.   I 
can   see  the  handkerchief  moving.'" 
Comprehension  Questions 
1.  Which  cat  became  scared? 

(Tiny  Cat) 
2.   Why  did  Merry  Cat  and  Tiny  Cat  go  out  into  the 
cornfield? 

(to  catch  a  mouse) 
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3.   Read  that  part  of  the  sentence  which  tells  us 
the  time  of  the  year. 

(the  com  was  all  picked) 
*.  What  did  the  two  cats  see  In  the  cornfield? 

(a  scarecrow) 
5.  How  did  the  scarecrow  scare  Tiny  Cat? 

(It  saw  the  handkerchief  move) 
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ORAL  READING  SELECTION  3 
(106  Words;  Third  Grade  Level) 


More  Friends  Old  and  '.'ew 
(p.  149) 


Preparation 

This  Is  a  story  about  a  flrehouse  cat.   As  you  read 
aloud  find  out  what  happened  when  he  fell  asleep  on  the 
flretruck- 
Selectlon 

The  huge  ladder  truck  soon  came  to  a  squealing  stop  Ir. 
front  of  a  burning  store.   The  hose  truck  pulled  up  just 
ahead  of  It.   Firemen  hopped  off  the  trucks  and  began  palling 
at  the  hoses-   A  large  crowd  of  people  was  standing  nearby, 
watching  the  bright  fire.   But  the  crowd  moved  back  as 
Fireman  Fat  led  the  way  to  the  burning  store.   In  a  few 
minutes  water  came  rushing  out  of  the  hoses.   It  hit  the  rir« 
with  a  loud  roar.   The  bright  fire  and  the  roaring  noise 
scared  Snowball.   He  curled  up  under  the  long  ladders  on  the 
truck,  trying  his  best  to  hide. 
Comprehension  Questions 

1.  What  happened  to  the  flrehouse  cat  when  he  fell 
asleep  on  the  firetruck? 

(he  went  on  a  fire-call) 

2.  What  was  burning? 

(a  store) 
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What  kirA   of  fire  truck  did  the  cat  ride? 

(ladder  truck) 

Read  the  sentence  which  tells  what  the  cat  did 

when  he  fcecame  scared. 

(he  curled  up  under  the  long  ladders  on  the 
truck) 

Find  the  word  that  means  the  same  as  "close." 
(nearby) 
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ORAL  READING  SELECTION  H 
(91  Words;  Fourth  Grade  Level) 


Roads  to  Follow 
(pp.  15^-lb!>) 


Preparation 

This  is  a  selection  about  the  Pilgrims.   As  you  read 
aloud  find  out  why  the  Pllerlcis  left  their  country. 
Selection 

William  Bradford,  who  was  governor  of  Plymouth  longer 
than  any  other  man,  wrote  a  history  of  the  tiny  settlement. 
In  his  history  he  told  how  plans  were  made  to  come  to  America 
He  explained  why  he  and  the  other  men  and  women  decided  to 
leave  their  own  country.   Goverr.or  Bradford  called  these 
people  "pilgrims"  because  they  set  out  to  find  a  land  where 
they  could  be  free  to  worship  In  the  way  they  wished.   Many 
years  later  everyone  who  talked  or  wrote  about  this  small 
company  of  settlers  called  the=  Pilgrims. 
Comprehension  Questions 

1.  Why  did  the  Fllgrlas  leave  their  country  for  a 
strange  land? 

(so  they  could  be  free  to  worship  in  the  way 
they  wished) 

2.  Who  was  the  first  to  call  these  people  Pilgrims? 

(William  Bradford) 
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3.  Who  was  governor  of  Plymouth  longer  than  any  other 
man? 

(V;iHlam  Bradford) 
It,      Name  the  word  In  the  story  which  means  "a  small 
village." 

(settlement) 
5.   Find  the  word  that  means  "to  express  a  feeling  of 
respect  for  God." 
(worship) 
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ORAL  READING  SELECTION  5 
(105  Words;  Fifth  Grade  Level) 


Ventures 
(p.  2^5) 


Preparation 

This  is  a  selection  about  the  Monarch  butterfly.   As 
you  read  aloud  think  of  a  good  name  for  this  article. 
Selection 

East  of  the  Rockies,  as  far  as  anyone  now  knows,  there 
is  no  one  spot  where  so  many  butterflies  gather.   But  the 
flight  of  the  eastern  monarchs  is  amazing.   Butterflies  from 
southern  Canada  and  northern  United  States  fly  all  the  way  to 
Mexico  and  the  tip  of  Florida  -  a  great  distance  for  creatures 
with  four-inch  wings.   There  are  many  questions  about  the 
flight  of  the  monarchs  that  scientists  are  trying  to  answer. 
Why  do  the  butterflies  go  to  the  same  trees  each  year?   How 
do  they  find  their  way  over  such  great  distances?  Vmat  routes 
do  they  take,  and  how  far  south  do  they  go? 
Comprehension  Questiona 

1.  What  would  be  a  good  name  for  this  article? 

(the  Mysterious  Honarch  /or/  the  Amazing 
Monarch) 

2.  To  which  two  places  do  the  monarchs  from  Canada 
and  northern  United  States  fly? 

(Mexico  and  tip  of  Florida) 


138 


3.  Why  are  the  monarchs  considered  mysterious? 

(there  are  many  questions  about  their  flight 
which  have  not  been  answered) 

4.  Find  the  word  that  means  the  same  as  "a  living 
being,  animal  or  human." 

(creature) 

5.  How  long  are  the  wln^s  of  the  monarch  butterfly? 

(four  Inches) 
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ORAL  READING  SELECTION  6 
(80  Words;  Sixth  Grade  Level) 


Vistas 


(p.  207) 

Preparation 

This  selection  Is  about  a  famous  doctor  and  his  animal 
friends.   As  you  read  orally  see  If  you  can  name  In  which 
part  of  the  world  the  story  takes  place. 
Selection 

All  the  sounds  of  the  Ogowe  country  are  wild  and 

fearful  sounds  -  the  trumpeting  of  elephants,  the  screams  of 

panthers,  the  cries  of  gorillas,  the  stomping  of  buffaloes. 

And  the  silences  are  wild  and  fearful,  too.   A  crocodile, 

pushing  his  eyes  up  over  the  edge  of  the  water.  Is  silent. 

A  whlte-bellled  shark,  streaking  uprlver.  Is  as  silent  as  a 

pointed  knife.   Up  and  down  the  Ogowe  River  there  Is  wlldness 

like  the  wlldness  when  the  world  first  began. 

Conpreher.slon  Questions 

1,   On  which  continent  do  you  believe  this  story  takes 

place? 

(Africa) 

2.   What  does  "and  the  silences  are  wild  and  fearful 

too"  mean? 

(though  silent  at  times  in  this  wilderness 
there  Is  danger  everywhere) 


no 


3.  Vhy  Is  the  white  bellied  shark  as  silent  as  a 
pointed  knife? 

(because  It  can  hurt  without  making  a  sound) 

4.  Find  the  word  that  means  "a  heavy  and  lively  step." 

(stomping) 

5.  IJame  four  forest  creatures  mentioned  in  the  story. 

(accept  any  four  of  the  following  -  elephants, 
panthers,  gorillas,  buffaloes,  crocodile, 
shark) 
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ORAL  READING  SELECTION'  7 
(100  Words;  Seventh  Grade  Level) 


Vistas 
(p.  2B2) 


Preparation 

This  selection  is  about  an  unusual  girl  from  Oregon 
who  had  a  strong  desire  to  study  medicine.   As  you  read 
orally  determine  her  character. 
Selection 

When  Bethenia  left  Roseburg  that  stormy  night,  she 
hoped  to  enter  Jefferson  College  in  Philadelphia,  one  of  the 
best  medical  schools  in  America.   However,  when  she  got  there 
and  applied  for  admission,  the  professor  who  interviewed  her 
only  laughed.   He  said  that  Jefferson  did  not  admit  wonen  and 
was  not  about  to  admit  them.   In  fact,  the  Jefferson  students 
had  recently  hurled  rotten  eggs  at  the  female  students  of  a 
medical  school  that  did  admit  women.   The  professor  did  not 
say  he  approved  of  such  conduct,  but  he  let  Bethenia  clearly 
understand  that  neither  did  he  approve  of  female  doctors. 
Comprehension  Questions 

1-  How  would  you  characterize  Bethenia? 

(optimistic  and  determined) 

2-  Why  did  the  Jefferson  students  hurl  rotten  eggs  at 

female  students  of  a  medical  school? 

(the  students  were  reflecting  the  attitude  of 
their  professors) 
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3.  How  did  the  Interviewing  professor  first  show  his 
prejudice  against  female  medical  students? 

(when  he  laughed  at  her  request  for  admission) 

4.  What  was  the  reputation  of  Jefferson  College? 

(one  of  the  best  medical  schools  in  the 
country) 

5.  V/hy  did  Bethenia  want  to  become  a  medical  doctor? 

(she  saw  a  need  for  female  doctors  /or/  she 
believed  women  could  be  just  as  successful  as 
men  in  the  medical  profession) 
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ORAL  READING  SELECTION  8 
(167  Words;  Eighth  Grade  Level) 


Challenges 
(pp.  k3'6-kkO) 


Preparation 

This  selection  is  about  one  of  the  great  scientists  of 
the  twentieth  century.  Dr.  Albert  Einstein.   After  retirement 
from  the  Institute  for  Advance  Study  at  Princeton  he  became 
depressed  over  his  role  In  the  development  of  the  atom  bomb. 
However,  his  attitude  changed  after  being  cheered  by  students 
while  crossing  the  Princeton  campus.   As  you  read  orally  note 
his  change  in  attitude  tov/ard  atomic  energy. 
Selection 

Still  smiling,  he  rounded  the  campus  on  his  way  home. 
He  realized  he  felt  at  least  ten  years  younger.   He  had 
decided  that  his  usefulness  to  the  world  was  not  a  thing  of 
the  past.   There  was  nuch  he  could  still  do.   "The  very 
menace  of  nuclear  warfare  may  intinldate  the  human  race  into 
bringing  order  into  its  International  affairs  which,  without 
the  pressure  of  fear,  it  would  not  do,"  he  dictated  that  very 
night.   Within  the  next  few  days  he  had  determined  to  overcome 
his  dislike  of  all  public  affairs  and  community  projects  and 
had  agreed  to  become  the  chairman  of  the  Emergency  Committee 
of  Atomic  Scientists  with  the  idea  of  finding  and  developing 
peacetime  uses  for  atonic  energy  so  that  it  could  be  used 


for  "the  benefit  of  mankind."  He  began  writing  articles  for 

magazines  and  making  commitments  to  speak  on  radio  and 

television  concerning  the  infinite  number  of  ways  in  which 

people  In  every  part  of  the  world  could  be  benefited  by  atomic 

energy . 

Comprehension  Questions 

1.   How  did  Professor  Einstein's  attitude  toward 

atomic  energy  change? 

(he  concluded  that  people  in  every  part  of 
the  world  could  benefit  from  peaceful  uses 
of  atomic  energy) 

2.   How  did  Professor  Einstein  attempt  to  justify  the 

atomic  bomb? 

(the  threat  of  atomic  warfare  may  compel 
nations  to  forego  warfare  in  resolving 
differences  among  and  between  nations) 

3.   \Vhat  did  Professor  Einstein  determine  to  do 

shortly  after  the  campus  episode? 

(to  overcome  his  dislike  of  all  public 
affairs  and  community  projects) 

i|.  Of  what  Important  organization  did  Professor 

Einstein  become  chairman? 

(Emergency  Committee  of  Atomic  Scientists 
/or/  Committee  of  Atomic  Scientists) 

5.   What  is  the  meaning  of  the  word  "Infinite"  in  the 

phrase  "Infinite  number  of  v;ays"? 

(endless  /or/  limitless  /or/  unending) 
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